-- Logs begin at Fri 2021-12-24 09:48:07 UTC, end at Fri 2021-12-24 11:02:22 UTC. -- Dec 24 10:36:30.592159 dv-cinder-816443-3-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Dec 24 10:36:30.601392 dv-cinder-816443-3-iscsi devstack@n-api.service[108997]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Dec 24 10:36:30.603637 dv-cinder-816443-3-iscsi devstack@n-api.service[108997]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Dec 24 10:36:30 2021] *** Dec 24 10:36:30.603637 dv-cinder-816443-3-iscsi devstack@n-api.service[108997]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Dec 24 10:36:30.603637 dv-cinder-816443-3-iscsi devstack@n-api.service[108997]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Dec 24 10:36:30.603637 dv-cinder-816443-3-iscsi devstack@n-api.service[108997]: nodename: dv-cinder-816443-3-iscsi Dec 24 10:36:30.603637 dv-cinder-816443-3-iscsi devstack@n-api.service[108997]: machine: x86_64 Dec 24 10:36:30.603637 dv-cinder-816443-3-iscsi devstack@n-api.service[108997]: clock source: unix Dec 24 10:36:30.603637 dv-cinder-816443-3-iscsi devstack@n-api.service[108997]: pcre jit disabled Dec 24 10:36:30.603637 dv-cinder-816443-3-iscsi devstack@n-api.service[108997]: detected number of CPU cores: 4 Dec 24 10:36:30.603637 dv-cinder-816443-3-iscsi devstack@n-api.service[108997]: current working directory: / Dec 24 10:36:30.603637 dv-cinder-816443-3-iscsi devstack@n-api.service[108997]: detected binary path: /usr/bin/uwsgi-core Dec 24 10:36:30.604322 dv-cinder-816443-3-iscsi devstack@n-api.service[108997]: your processes number limit is 47680 Dec 24 10:36:30.604322 dv-cinder-816443-3-iscsi devstack@n-api.service[108997]: your memory page size is 4096 bytes Dec 24 10:36:30.604322 dv-cinder-816443-3-iscsi devstack@n-api.service[108997]: detected max file descriptor number: 2048 Dec 24 10:36:30.604322 dv-cinder-816443-3-iscsi devstack@n-api.service[108997]: lock engine: pthread robust mutexes Dec 24 10:36:30.604322 dv-cinder-816443-3-iscsi devstack@n-api.service[108997]: thunder lock: enabled Dec 24 10:36:30.604322 dv-cinder-816443-3-iscsi devstack@n-api.service[108997]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Dec 24 10:36:30.604322 dv-cinder-816443-3-iscsi devstack@n-api.service[108997]: Python version: 3.8.10 (default, Nov 26 2021, 20:14:08) [GCC 9.3.0] Dec 24 10:36:30.648275 dv-cinder-816443-3-iscsi devstack@n-api.service[108997]: Python main interpreter initialized at 0x558a4aa779c0 Dec 24 10:36:30.648275 dv-cinder-816443-3-iscsi devstack@n-api.service[108997]: python threads support enabled Dec 24 10:36:30.648275 dv-cinder-816443-3-iscsi devstack@n-api.service[108997]: your server socket listen backlog is limited to 100 connections Dec 24 10:36:30.648275 dv-cinder-816443-3-iscsi devstack@n-api.service[108997]: your mercy for graceful operations on workers is 90 seconds Dec 24 10:36:30.649299 dv-cinder-816443-3-iscsi devstack@n-api.service[108997]: mapped 403077 bytes (393 KB) for 2 cores Dec 24 10:36:30.649299 dv-cinder-816443-3-iscsi devstack@n-api.service[108997]: *** Operational MODE: preforking *** Dec 24 10:36:30.649557 dv-cinder-816443-3-iscsi devstack@n-api.service[108997]: *** uWSGI is running in multiple interpreter mode *** Dec 24 10:36:30.649557 dv-cinder-816443-3-iscsi devstack@n-api.service[108997]: spawned uWSGI master process (pid: 108997) Dec 24 10:36:30.649767 dv-cinder-816443-3-iscsi systemd[1]: Started Devstack devstack@n-api.service. Dec 24 10:36:30.656840 dv-cinder-816443-3-iscsi devstack@n-api.service[108997]: spawned uWSGI worker 1 (pid: 108998, cores: 1) Dec 24 10:36:30.656840 dv-cinder-816443-3-iscsi devstack@n-api.service[108997]: spawned uWSGI worker 2 (pid: 108999, cores: 1) Dec 24 10:36:30.656840 dv-cinder-816443-3-iscsi devstack@n-api.service[108997]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Dec 24 10:36:32.365762 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 24 10:36:32.365762 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: from cryptography.utils import int_from_bytes Dec 24 10:36:32.366427 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 24 10:36:32.366427 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: from cryptography.utils import int_from_bytes Dec 24 10:36:32.366545 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 24 10:36:32.366545 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: from cryptography.utils import int_from_bytes Dec 24 10:36:32.367445 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 24 10:36:32.367445 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: from cryptography.utils import int_from_bytes Dec 24 10:36:34.919321 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Dec 24 10:36:34.919928 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Dec 24 10:36:34.919928 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Dec 24 10:36:34.920389 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Dec 24 10:36:34.920493 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Dec 24 10:36:34.920583 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Dec 24 10:36:34.920583 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Dec 24 10:36:34.920740 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Dec 24 10:36:34.920846 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Dec 24 10:36:34.920945 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Dec 24 10:36:34.921035 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:36:34.921370 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:36:34.921610 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:36:34.921717 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:36:34.921927 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:36:34.922026 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:36:34.922242 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:36:34.922336 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:36:34.922569 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:36:34.922683 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:36:34.922878 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:36:34.922999 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:36:34.923198 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:36:34.923300 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:36:34.923512 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:36:34.923606 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:36:34.923836 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:36:34.923929 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:36:34.924093 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:36:34.924192 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:36:34.924407 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:36:34.924500 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:36:34.924728 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-816443-3-iscsi {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:36:34.924900 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-816443-3-iscsi {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:36:34.925074 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:36:34.925160 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:36:34.925378 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:36:34.925480 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:36:34.925686 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:36:34.925778 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:36:34.925999 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:36:34.926084 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:36:34.926302 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:36:34.926395 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:36:34.926618 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:36:34.926737 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:36:34.926922 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:36:34.927015 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:36:34.927418 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:36:34.927522 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:36:34.928553 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:36:34.928693 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:36:34.928808 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:36:34.928943 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:36:34.929080 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:36:34.929166 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:36:34.929293 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:36:34.929384 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:36:34.929465 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:36:34.929554 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:36:34.929633 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:36:34.929762 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:36:34.929845 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:36:34.929933 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:36:34.930039 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:36:34.930135 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:36:34.930361 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:36:34.930446 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:36:34.930701 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:36:34.930798 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:36:34.931062 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-816443-3-iscsi {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:36:34.931152 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-816443-3-iscsi {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:36:34.931378 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:36:34.931471 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:36:34.931689 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:36:34.931795 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:36:34.931999 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:36:34.932086 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:36:34.932406 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:36:34.932500 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:36:34.932721 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:36:34.932907 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:36:34.933056 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:36:34.933215 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:36:34.933392 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:36:34.933482 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:36:34.933693 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:36:34.933783 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:36:34.934001 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:36:34.934088 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:36:34.934323 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:36:34.934410 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:36:34.934641 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:36:34.934740 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:36:34.934956 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:36:34.935042 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:36:34.935273 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:36:34.935366 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:36:34.935574 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:36:34.935673 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:36:34.935882 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:36:34.935975 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:36:34.936185 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:36:34.936278 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:36:34.936503 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:36:34.936599 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:36:34.936808 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:36:34.936908 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:36:34.937137 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:36:34.937249 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:36:34.937390 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:36:34.937486 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:36:34.937696 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:36:34.937790 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:36:34.938013 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:36:34.938097 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:36:34.938331 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:36:34.938426 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:36:34.938651 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:36:34.938738 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:36:34.938900 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:36:34.939007 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:36:34.939150 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:36:34.939256 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:36:34.939467 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:36:34.939561 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:36:34.939784 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:36:34.939878 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:36:34.940091 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:36:34.940181 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:36:34.940397 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:36:34.940489 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:36:34.940699 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:36:34.940793 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:36:34.941031 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:36:34.941117 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:36:34.941335 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:36:34.941419 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:36:34.941641 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:36:34.941739 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:36:34.941945 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:36:34.942039 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:36:34.942248 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:36:34.942331 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:36:34.942562 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:36:34.942649 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:36:34.942872 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:36:34.942955 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:36:34.943194 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:36:34.943303 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:36:34.943501 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:36:34.943599 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:36:34.943814 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:36:34.943898 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:36:34.944205 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.30 {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:36:34.944296 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.30 {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:36:34.944457 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.30 {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:36:34.944552 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.30 {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:36:34.944761 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:36:34.944878 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:36:34.945641 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:36:34.945743 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:36:34.945962 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:36:34.946048 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:36:34.946274 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:36:34.946366 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:36:34.946592 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:36:34.946686 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:36:34.946912 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:36:34.947006 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:36:34.947218 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:36:34.947303 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:36:34.947523 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:36:34.947629 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:36:34.947828 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:36:34.947913 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:36:34.948146 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:36:34.948230 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:36:34.948474 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:36:34.948570 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:36:34.948776 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:36:34.948882 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:36:34.949049 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:36:34.949133 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:36:34.949349 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:36:34.949434 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:36:34.949649 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:36:34.949740 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:36:34.949966 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:36:34.950056 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:36:34.950269 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:36:34.950353 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:36:34.950575 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:36:34.950660 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:36:34.950876 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:36:34.950959 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:36:34.951173 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:36:34.951264 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:36:34.951475 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:36:34.951560 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:36:34.951782 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:36:34.951871 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:36:34.952085 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:36:34.952171 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:36:34.952390 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:36:34.952486 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:36:34.952691 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:36:34.952775 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:36:34.953020 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:36:34.953108 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:36:34.953325 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:36:34.953413 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:36:34.953626 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:36:34.953724 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:36:34.953927 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:36:34.954011 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:36:34.954240 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:36:34.954329 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:36:34.954555 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:36:34.954647 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:36:34.954858 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:36:34.954941 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:36:34.955160 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:36:34.955244 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:36:34.955464 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:36:34.955559 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:36:34.955767 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:36:34.955852 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:36:34.956082 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:36:34.956174 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:36:34.956384 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:36:34.956475 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:36:34.956690 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:36:34.956781 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:36:34.957030 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:36:34.957131 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:36:34.957334 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:36:34.957466 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:36:34.957639 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:36:34.957731 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:36:34.957954 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:36:34.958039 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:36:34.958257 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:36:34.958352 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:36:34.958561 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:36:34.958646 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:36:34.958874 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:36:34.958959 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:36:34.959171 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:36:34.959268 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:36:34.959472 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:36:34.959557 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:36:34.959784 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:36:34.959869 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:36:34.960089 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:36:34.960181 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:36:34.960390 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:36:34.960474 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:36:34.961269 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:36:34.961381 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:36:34.961586 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:36:34.961683 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:36:34.961893 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:36:34.961980 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:36:34.962197 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:36:34.962280 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:36:34.962497 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:36:34.962582 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:36:34.962797 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:36:34.962882 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:36:34.963097 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:36:34.963182 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:36:34.963411 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:36:34.963506 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:36:34.963729 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:36:34.963820 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:36:34.964033 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:36:34.964128 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:36:34.964339 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:36:34.964424 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:36:34.964643 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:36:34.964727 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:36:34.964982 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:36:34.965081 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:36:34.965315 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:34.965401 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:34.965643 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:34.965729 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:34.965982 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:34.966079 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:34.966292 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:34.966380 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:34.966620 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:34.966712 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:34.966947 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:34.967045 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:34.967261 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:34.967345 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:34.967571 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:34.967660 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:34.967883 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:34.967996 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:34.968206 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:34.968298 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:34.968514 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:34.968598 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:34.968831 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:34.968918 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:34.969159 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:34.969254 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:34.969478 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:34.969569 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:34.969792 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:34.969884 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:34.970118 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:34.970228 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:34.970431 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:34.970517 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:34.970747 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:34.970833 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:34.971065 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:34.971151 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:34.971374 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:34.971465 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:34.971688 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:34.971774 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:34.972014 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:34.972120 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:34.972335 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:34.972427 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:34.972644 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:34.972730 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:34.973011 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:34.973099 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:34.973349 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:34.973487 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:34.973661 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:34.973747 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:34.973985 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:34.974079 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:34.974292 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:34.974388 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:34.974611 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:34.974703 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:34.974919 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:34.975004 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:34.975228 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:34.975327 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:34.975539 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:34.975625 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:34.975864 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:34.975949 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:34.976198 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:34.976309 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:34.976514 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:34.976601 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:34.976863 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:34.976951 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:34.977183 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:34.977285 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:34.977499 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:34.977583 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:34.977803 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:34.977890 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:34.978106 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:34.978192 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:34.978408 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:34.978494 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:34.978717 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:34.978803 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:34.979018 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:34.979103 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:34.979335 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:34.979427 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:34.979660 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:34.979748 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:34.979964 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:34.980056 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:34.980291 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:34.980384 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:34.980595 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:34.980679 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:34.980925 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:34.981023 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:34.981236 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:34.981322 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:34.981543 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:34.981650 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:34.981851 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:34.981937 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:34.982160 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:34.982252 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:34.982462 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:34.982555 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:34.982780 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:34.982865 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:34.983089 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:34.983176 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:34.983392 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:34.983489 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:34.983712 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:34.983807 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:34.984016 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:34.984100 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:34.984317 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:34.984412 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:34.984631 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:34.984714 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:34.984962 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:34.985062 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:34.985274 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:34.985368 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:34.985582 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:34.985675 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:34.985902 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:34.985988 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:34.986210 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:34.986296 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:34.986521 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:34.986606 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:34.986853 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:34.986938 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:34.987182 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:34.987267 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:34.987486 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:34.987571 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:34.987809 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:34.987893 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:34.988132 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:34.988218 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:34.988446 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:34.988531 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:34.988746 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:34.988857 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:34.989111 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:34.989206 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:34.989419 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:34.989504 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:34.989724 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:34.989820 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:34.990028 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:34.990111 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:34.990334 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:34.990417 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:34.990638 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:34.990731 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:34.990939 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:34.991023 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:34.991241 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:34.991327 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:34.991544 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:34.991636 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:34.991875 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:34.991961 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:34.992194 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:34.992323 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:34.992503 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:34.992588 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:34.992804 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:34.992936 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:34.993130 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:34.993226 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:34.993430 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:34.993517 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:34.993775 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:34.993862 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:34.994079 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:34.994165 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:34.994418 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:34.994506 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:34.994749 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:34.994840 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:34.995063 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:34.995154 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:34.995384 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:34.995469 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:34.995693 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:34.995784 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:34.996007 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:34.996103 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:34.996314 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:34.996398 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:34.996625 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:34.996710 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:34.996957 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:34.997057 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:34.997269 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:34.997360 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:34.997586 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:34.997677 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:34.997897 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:34.997997 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:34.998212 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:34.998296 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:34.998521 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:34.998606 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:34.998841 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:34.998934 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:34.999153 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:34.999239 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:34.999469 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:34.999596 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:34.999772 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:34.999864 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.000081 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.000171 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.000419 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.000503 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.000746 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.000898 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.001088 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.001172 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.001407 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.001492 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.001716 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.001802 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.002025 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.002109 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.002333 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.002417 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.002640 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.002726 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.002950 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.003042 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.003258 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.003351 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.003570 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.003662 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.003878 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.003973 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.004192 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.004290 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.004495 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.004580 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.004830 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.004918 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.005144 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.005241 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.005458 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.005544 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.005760 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.005857 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.006068 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.006160 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.006392 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.006484 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.006718 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.006803 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.007027 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.007122 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.007846 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.007984 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.008179 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.008293 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.008490 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.008585 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.008799 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.008930 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.009134 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.009222 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.009437 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.009523 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.009741 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.009826 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.010050 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.010135 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.010366 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.010454 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.010673 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.010757 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.010980 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.011072 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.011284 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.011376 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.011595 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.011686 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.011902 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.011998 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.012204 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.012291 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.012504 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.012589 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.012833 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.012935 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.013156 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.013241 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.013469 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.013556 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.013788 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.013884 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.014105 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.014205 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.014407 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.014496 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.014710 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.014803 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.015026 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.015118 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.015332 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.015423 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.015633 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.015725 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.015936 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.016026 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.016236 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.016320 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.016576 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.016662 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.016908 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.016998 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.017214 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.017299 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.017529 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.017615 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.017850 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.017935 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.018158 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.018242 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.018473 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.018566 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.018782 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.018866 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.019092 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.019183 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.019412 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.019497 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.019727 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.019817 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.020033 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.020126 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.020344 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.020428 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.020651 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.020743 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.020986 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.021087 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.021300 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.021386 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.021621 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.021706 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.021930 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.022023 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.022240 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.022324 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.022551 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.022635 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.022852 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.023054 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.023705 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.023793 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.024026 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.024112 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.024595 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.024689 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.024948 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.025038 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.025265 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.025359 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.025582 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.025668 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.025901 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.025987 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.026219 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.026303 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.026544 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.026631 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.026872 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.026957 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.027182 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.027275 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.027487 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.027572 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.027807 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.027974 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.028099 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.028196 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.028401 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.028492 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.028710 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.028826 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.029041 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.029144 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.029343 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.029428 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.029647 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.029731 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.029953 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.030046 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.030256 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.030340 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.030556 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.030641 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.030885 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.030981 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.031189 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.031285 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.031500 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.031593 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.031803 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.031895 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.032113 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.032207 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.032413 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.032497 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.032733 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.032861 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.033064 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.033161 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.033368 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.033454 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.033679 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.033766 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.033983 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.034078 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.034329 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.034426 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.034632 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.034719 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.034966 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.035105 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.035292 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.035377 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.035631 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.035716 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.035934 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.036028 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.036237 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.036322 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.036560 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.036644 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.036885 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.036975 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.037189 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.037273 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.037492 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.037593 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.037797 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.037888 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.038104 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.038189 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.038402 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.038494 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.038733 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.038817 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.039048 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.039135 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.039355 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.039448 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.039659 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.039744 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.039958 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.040042 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.040266 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.040362 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.040565 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.040650 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.040902 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.040989 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.041210 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.041297 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.041510 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.041594 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.041809 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.041893 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.042118 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.042204 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.042421 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.042512 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.042723 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.042852 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.043030 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.043123 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.043331 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.043425 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.043643 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.043735 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.043944 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.044030 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.044243 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.044327 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.044544 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.044682 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.044870 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.044962 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.045181 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.045269 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.045482 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.045576 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.045802 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.045888 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.046359 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.046450 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.046662 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.046756 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.046958 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.047049 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.047265 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.047349 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.047565 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.047663 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.047866 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.047952 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.048169 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.048253 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.048486 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.048627 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.048797 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.048953 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.049121 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.049208 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.049431 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.049524 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.049735 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.049827 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.050037 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.050129 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.050340 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.050432 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.050643 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.050734 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.050945 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.051030 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.051242 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.051327 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.051541 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.051626 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.051842 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.052022 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.052141 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.052228 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.052458 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.052544 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.052761 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.052885 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.053089 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.053176 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.053391 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.053477 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.053688 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.053784 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.054032 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.054120 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.054357 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.054447 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.054716 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.054811 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.055021 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.055114 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.055336 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.055423 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.055650 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.055737 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.055960 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.056046 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.056269 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.056354 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.056581 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.056667 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.056902 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.056991 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.057219 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.057312 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.057560 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.057652 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.057822 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.057925 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.058122 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.058207 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.058422 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.058509 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.058742 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.058838 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.059047 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.059136 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.059354 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.059441 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.059675 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.059763 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.059992 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.060086 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.060312 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.060406 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.060611 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.060697 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.060945 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.061050 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.061254 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.061340 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.061562 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.061655 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.061865 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.061963 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.062170 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.062258 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.062477 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.062570 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.062784 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.062880 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.063093 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.063196 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.063395 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.063483 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.063704 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.063793 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.064007 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.064095 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.064310 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.064402 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.064615 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.064705 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.064942 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.065035 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.065265 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.065368 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.065569 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.065656 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.065870 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.065957 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.066172 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.066257 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.066475 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.066562 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.066783 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.066876 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.067084 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.067225 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.067500 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.067586 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.067811 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.067896 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.068118 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.068216 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.068422 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.068509 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.068725 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.068833 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.069060 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.069158 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.069372 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.069458 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.069688 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.069777 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.070515 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.070623 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.070931 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.071026 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.071241 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.071329 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.071550 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.071638 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.071859 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.071946 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.072162 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.072248 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.072461 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.072550 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.072768 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.072891 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.073116 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.073202 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.073418 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.073511 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.073718 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.073804 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.074019 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.074105 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.074337 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.074423 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.074639 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.074734 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.074958 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.075053 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.075372 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.075466 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.075679 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.075766 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.075983 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.076076 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.076388 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.076482 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.076695 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.076781 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.077029 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.077128 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.077354 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.077446 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.077668 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.077760 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.077989 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.078091 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.078291 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.078389 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.078606 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.078693 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.078911 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.079004 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.079230 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.079315 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.079545 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.079638 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.079855 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.079948 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.080164 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.080258 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.080465 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.080558 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.080781 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.080917 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.081124 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.081210 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.081435 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.081586 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.081753 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.081846 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.082157 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.082243 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.082476 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.082588 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.082782 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.082869 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.083099 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.083225 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.083419 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.083512 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.083724 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.083820 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.084024 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.084150 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.084330 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.084417 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.084633 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.084729 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.084957 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.085046 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.085277 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.085374 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.086119 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.086224 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.086435 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.086523 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.086745 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.086835 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.087050 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.087145 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.087353 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.087439 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.087651 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.087737 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.087968 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.088055 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.088267 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.088354 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.088586 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.088695 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.088927 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.089019 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.089248 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.089345 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.089568 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.089654 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.089871 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.089959 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.090187 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.090281 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.090494 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.090580 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.090795 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.090882 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.091095 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.091189 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.091397 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.091494 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.091739 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.091825 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.092043 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.092128 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.092361 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.092455 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.092690 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.092776 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.093044 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.093132 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.093356 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.093457 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.093695 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.093781 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.094020 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.094887 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.094887 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.095056 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.095138 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.095206 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.095283 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.095362 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.095449 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.095530 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.095608 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.095687 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.095832 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.095921 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.096137 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.096225 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.096439 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.096525 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.096742 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.096859 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.097078 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.097166 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.097378 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.097470 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.097681 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.097767 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.097983 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.098070 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.098309 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.098408 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.098610 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.098713 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.098932 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.099019 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.099239 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.099337 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.099542 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.099641 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.099845 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.099933 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.100145 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.100231 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.100493 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.100588 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.100794 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.100932 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.101177 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.101267 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.101503 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.101604 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.101821 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.101906 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.102149 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.102234 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.102548 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.102642 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.102779 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.102866 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.103093 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.103178 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.103408 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.103496 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.103724 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.103811 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.104445 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.104540 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.104540 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.104673 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.104739 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.104837 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.104977 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.105054 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.105288 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.105384 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.105600 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.105696 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.105915 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.106018 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.106227 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.106314 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.106793 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.106905 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.107121 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.107217 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.107433 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.107520 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.107750 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.107846 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.108060 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.108163 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.108372 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.108458 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.108684 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.108791 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.109020 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.109124 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.109332 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.109422 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.109642 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.109730 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.109952 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.110040 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.110292 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.110388 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.110596 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.110690 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.110922 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.111009 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.111257 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.111343 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.111574 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.111668 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.111889 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.111975 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.112201 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.112287 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.112513 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.112686 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.112894 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.112991 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.113212 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.113299 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.113517 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.113614 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.113832 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.113919 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.114147 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.114234 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.114461 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.114553 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.114771 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.114857 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.115076 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.115170 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.115388 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.115482 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.115697 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.115783 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.116004 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.116100 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.116312 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.116398 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.116628 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.116756 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.116990 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.117100 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.117318 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.117409 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.117649 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.117738 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.117965 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.118063 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.118275 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.118364 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.118585 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.118692 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.118899 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.118998 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.119413 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.119518 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.119725 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.119825 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.120057 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.120163 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.120380 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.120478 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.120702 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.120808 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.121042 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.121149 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.121356 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.121457 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.121678 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.121778 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.121983 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.122074 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.122285 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.122375 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.122592 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.122694 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.122899 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.122989 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.123199 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.123295 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.123519 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.123618 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.123828 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.123918 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.124130 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.124218 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.124447 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.124545 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.124755 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.124864 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.125307 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.125417 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.125651 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.125751 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.125969 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.126067 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.126292 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.126392 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.126617 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.126707 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.126932 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.127029 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.127236 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.127327 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.127560 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.127653 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.127933 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.128117 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.128209 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.128291 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.128529 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.128619 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.128858 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.128951 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.129167 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.129254 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.129474 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.129563 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.129787 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.129897 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.130100 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.130221 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.130401 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.130500 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.130710 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.130809 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.131011 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.131121 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.131335 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.131433 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.131637 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.131735 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.131940 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.132047 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.132238 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.132874 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.133101 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.133200 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.133409 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.133523 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.133710 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.133809 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.134013 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.134111 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.134314 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.134413 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.134624 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.134722 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.134923 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.135022 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.135251 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.135412 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.135547 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.135686 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.135825 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.135969 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.136119 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.136270 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.136410 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.136548 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.136686 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.136880 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.137033 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.137186 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.137325 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.137463 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.137601 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.137749 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.137895 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.138033 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.138195 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.138334 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.138503 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.138653 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.138800 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.138937 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.139109 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.139259 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.139472 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.139622 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.139774 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.139863 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.140300 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.140444 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.140680 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.140780 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.141026 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.141132 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.141363 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.141453 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.141700 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.141790 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.142003 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.142092 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.142309 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.142405 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.142610 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.142710 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.142931 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.143022 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.143237 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.143334 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.143546 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.143636 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.143852 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.143942 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.144161 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.144251 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.144468 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.144558 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.144775 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.144885 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.145107 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.145211 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.145412 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.145510 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.145722 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.145816 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.146034 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.146131 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.146371 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.146463 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.146685 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.146773 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.147001 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.147098 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.147313 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.147400 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.147628 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.147716 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.147936 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.148059 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.148296 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.148387 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.148610 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.148700 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.148944 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.149040 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.149263 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.149362 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.149591 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.149731 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.149903 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.149992 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.150205 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.150296 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.150630 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.150728 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.150942 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.151031 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.151257 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.151344 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.151575 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.151671 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.151881 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.151977 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.152199 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.152296 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.152517 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.152615 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.152836 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.152929 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.153160 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.153249 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.153469 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.153571 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.153794 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.153883 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.154131 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.154220 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.154458 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.154548 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.154779 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.154868 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.155083 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.155171 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.155384 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.155511 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.155685 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.155774 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.155991 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.156089 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.156318 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.156413 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.156645 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.156732 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.156984 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.157094 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.157303 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.157398 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.157612 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.157700 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.157929 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.158025 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.158234 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.158322 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.158550 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.158638 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.158870 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.158967 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.159180 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.159274 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.159487 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.159580 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.159812 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.159912 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.160120 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.160260 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.160427 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.160515 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.160735 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.160863 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.161068 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.161168 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.161376 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.161465 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.161682 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.161772 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.162006 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.162097 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.162327 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.162423 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.162629 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.162718 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.162948 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.163045 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.163261 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.163358 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.163601 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.164211 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.164419 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.164508 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.164727 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.164846 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.165077 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.165168 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.165386 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.165475 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.165699 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.165798 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.166004 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.166101 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.166331 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.166428 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.166624 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.166713 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.166937 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.167033 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.167258 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.167354 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.167580 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.167669 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.167900 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.167995 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.168221 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.168326 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.168563 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.168653 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.168899 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.168994 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.169242 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.169341 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.169574 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.169666 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.169877 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.169965 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.170190 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.170329 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.170491 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.170580 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:36:35.170731 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=108998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Dec 24 10:36:35.170818 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=108999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Dec 24 10:36:35.193732 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG oslo_db.sqlalchemy.engines [None req-a556e0fc-5fff-44b3-bb1d-66174241067b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=108999) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 24 10:36:35.196119 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG oslo_db.sqlalchemy.engines [None req-347830a0-30d7-42b2-8e94-b1fd7d942fca None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=108998) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 24 10:36:35.259689 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.context [None req-a556e0fc-5fff-44b3-bb1d-66174241067b None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),bfb47192-5c7e-4e04-9bc9-d8065be13f1d(cell1) {{(pid=108999) load_cells /opt/stack/nova/nova/context.py:464}} Dec 24 10:36:35.259926 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.context [None req-347830a0-30d7-42b2-8e94-b1fd7d942fca None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),bfb47192-5c7e-4e04-9bc9-d8065be13f1d(cell1) {{(pid=108998) load_cells /opt/stack/nova/nova/context.py:464}} Dec 24 10:36:35.263884 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG oslo_concurrency.lockutils [None req-a556e0fc-5fff-44b3-bb1d-66174241067b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:36:35.264092 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG oslo_concurrency.lockutils [None req-347830a0-30d7-42b2-8e94-b1fd7d942fca None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:36:35.268336 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG oslo_concurrency.lockutils [None req-a556e0fc-5fff-44b3-bb1d-66174241067b None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:36:35.268465 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG oslo_concurrency.lockutils [None req-347830a0-30d7-42b2-8e94-b1fd7d942fca None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:36:35.268576 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG oslo_concurrency.lockutils [None req-a556e0fc-5fff-44b3-bb1d-66174241067b None None] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:36:35.268653 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG oslo_concurrency.lockutils [None req-347830a0-30d7-42b2-8e94-b1fd7d942fca None None] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:36:35.268733 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG oslo_concurrency.lockutils [None req-a556e0fc-5fff-44b3-bb1d-66174241067b None None] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:36:35.268845 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG oslo_concurrency.lockutils [None req-347830a0-30d7-42b2-8e94-b1fd7d942fca None None] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:36:35.279154 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG oslo_db.sqlalchemy.engines [None req-a556e0fc-5fff-44b3-bb1d-66174241067b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=108999) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 24 10:36:35.282041 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG oslo_db.sqlalchemy.engines [None req-347830a0-30d7-42b2-8e94-b1fd7d942fca None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=108998) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 24 10:36:35.282921 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG oslo_db.sqlalchemy.engines [None req-347830a0-30d7-42b2-8e94-b1fd7d942fca None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=108998) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 24 10:36:35.285987 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG oslo_db.sqlalchemy.engines [None req-a556e0fc-5fff-44b3-bb1d-66174241067b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=108999) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 24 10:36:35.448648 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG oslo_db.sqlalchemy.engines [None req-347830a0-30d7-42b2-8e94-b1fd7d942fca None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=108998) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 24 10:36:35.458224 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG oslo_db.sqlalchemy.engines [None req-a556e0fc-5fff-44b3-bb1d-66174241067b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=108999) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 24 10:36:35.871426 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: WARNING keystonemiddleware.auth_token [None req-347830a0-30d7-42b2-8e94-b1fd7d942fca None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 24 10:36:35.878155 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: WARNING keystonemiddleware.auth_token [None req-347830a0-30d7-42b2-8e94-b1fd7d942fca None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 24 10:36:35.893870 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: WARNING keystonemiddleware.auth_token [None req-a556e0fc-5fff-44b3-bb1d-66174241067b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 24 10:36:35.900474 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: WARNING keystonemiddleware.auth_token [None req-a556e0fc-5fff-44b3-bb1d-66174241067b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 24 10:36:36.226650 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: WARNING keystonemiddleware.auth_token [None req-347830a0-30d7-42b2-8e94-b1fd7d942fca None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 24 10:36:36.231999 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: WARNING keystonemiddleware.auth_token [None req-347830a0-30d7-42b2-8e94-b1fd7d942fca None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 24 10:36:36.237173 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x558a4aa779c0 pid: 108998 (default app) Dec 24 10:36:36.239244 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi [None req-347830a0-30d7-42b2-8e94-b1fd7d942fca None None] Calling method '>' {{(pid=108998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:36:36.240317 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: WARNING keystonemiddleware.auth_token [None req-a556e0fc-5fff-44b3-bb1d-66174241067b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 24 10:36:36.240677 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: INFO nova.api.openstack.requestlog [None req-347830a0-30d7-42b2-8e94-b1fd7d942fca None None] 10.222.0.30 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001719 Dec 24 10:36:36.240842 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: [pid: 108998|app: 0|req: 1/1] 10.222.0.30 () {50 vars in 788 bytes} [Fri Dec 24 10:36:36 2021] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 10:36:36.245656 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: WARNING keystonemiddleware.auth_token [None req-a556e0fc-5fff-44b3-bb1d-66174241067b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 24 10:36:36.250746 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x558a4aa779c0 pid: 108999 (default app) Dec 24 10:38:05.641527 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi [None req-347830a0-30d7-42b2-8e94-b1fd7d942fca None None] Calling method '>' {{(pid=108998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:38:05.642566 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: INFO nova.api.openstack.requestlog [None req-347830a0-30d7-42b2-8e94-b1fd7d942fca None None] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001460 Dec 24 10:38:05.642996 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: [pid: 108998|app: 0|req: 2/2] 10.222.0.30 () {54 vars in 930 bytes} [Fri Dec 24 10:38:05 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 10:38:06.066370 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi [None req-bc54a550-1f93-46db-a993-832da888bf06 admin admin] Calling method '>' {{(pid=108999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:38:06.095164 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: INFO nova.api.openstack.requestlog [None req-bc54a550-1f93-46db-a993-832da888bf06 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.444046 Dec 24 10:38:06.095917 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: [pid: 108999|app: 0|req: 1/3] 10.222.0.30 () {60 vars in 1291 bytes} [Fri Dec 24 10:38:05 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:38:08.498367 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi [None req-347830a0-30d7-42b2-8e94-b1fd7d942fca None None] Calling method '>' {{(pid=108998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:38:08.499399 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: INFO nova.api.openstack.requestlog [None req-347830a0-30d7-42b2-8e94-b1fd7d942fca None None] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001398 Dec 24 10:38:08.499984 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: [pid: 108998|app: 0|req: 3/4] 10.222.0.30 () {54 vars in 930 bytes} [Fri Dec 24 10:38:08 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 10:38:08.565811 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi [None req-159f5060-8225-46ed-8f2f-cad12bbb4690 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 256, "vcpus": 1, "rxtx_factor": 1.0, "swap": 0, "disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "c1", "os-flavor-access:is_public": true, "name": "cirros256"}} {{(pid=108999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:38:08.584183 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 10:38:08.584183 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: warnings.warn(msg) Dec 24 10:38:08.678849 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: INFO nova.api.openstack.requestlog [None req-159f5060-8225-46ed-8f2f-cad12bbb4690 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.171692 Dec 24 10:38:08.679881 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: [pid: 108999|app: 0|req: 2/5] 10.222.0.30 () {64 vars in 1282 bytes} [Fri Dec 24 10:38:08 2021] POST /compute/v2.1/flavors => generated 407 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 24 10:38:08.895737 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi [None req-48238f7f-d8af-48ff-8f61-b3a7ce00859f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=108998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:38:08.897978 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 10:38:08.897978 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: warnings.warn(msg) Dec 24 10:38:09.009173 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: INFO nova.api.openstack.requestlog [None req-48238f7f-d8af-48ff-8f61-b3a7ce00859f admin admin] 10.222.0.30 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.321079 Dec 24 10:38:09.010022 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: [pid: 108998|app: 0|req: 4/6] 10.222.0.30 () {64 vars in 1335 bytes} [Fri Dec 24 10:38:08 2021] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:38:11.413565 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi [None req-159f5060-8225-46ed-8f2f-cad12bbb4690 admin admin] Calling method '>' {{(pid=108999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:38:11.414606 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: INFO nova.api.openstack.requestlog [None req-159f5060-8225-46ed-8f2f-cad12bbb4690 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001478 Dec 24 10:38:11.415155 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: [pid: 108999|app: 0|req: 3/7] 10.222.0.30 () {54 vars in 930 bytes} [Fri Dec 24 10:38:11 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 10:38:11.534937 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi [None req-506908a5-55b4-4cd5-9f0e-71f0daf794c4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d1", "vcpus": 1, "ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "name": "ds512M", "disk": 5}} {{(pid=108998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:38:11.553811 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 10:38:11.553811 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: warnings.warn(msg) Dec 24 10:38:11.649082 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: INFO nova.api.openstack.requestlog [None req-506908a5-55b4-4cd5-9f0e-71f0daf794c4 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.227255 Dec 24 10:38:11.649708 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: [pid: 108998|app: 0|req: 5/8] 10.222.0.30 () {64 vars in 1282 bytes} [Fri Dec 24 10:38:11 2021] POST /compute/v2.1/flavors => generated 404 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 24 10:38:11.662666 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi [None req-74c42227-3a7f-4a43-b565-4876e5399220 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=108999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:38:11.664157 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 10:38:11.664157 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: warnings.warn(msg) Dec 24 10:38:11.743697 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: INFO nova.api.openstack.requestlog [None req-74c42227-3a7f-4a43-b565-4876e5399220 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.085021 Dec 24 10:38:11.752988 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: [pid: 108999|app: 0|req: 4/9] 10.222.0.30 () {64 vars in 1335 bytes} [Fri Dec 24 10:38:11 2021] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:38:14.121581 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi [None req-506908a5-55b4-4cd5-9f0e-71f0daf794c4 admin admin] Calling method '>' {{(pid=108998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:38:14.122529 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: INFO nova.api.openstack.requestlog [None req-506908a5-55b4-4cd5-9f0e-71f0daf794c4 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001491 Dec 24 10:38:14.124111 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: [pid: 108998|app: 0|req: 6/10] 10.222.0.30 () {54 vars in 930 bytes} [Fri Dec 24 10:38:14 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 10:38:14.182637 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi [None req-5335e647-a8bb-4105-912f-6b31ac608e99 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "ram": 1024, "vcpus": 1, "id": "d2", "rxtx_factor": 1.0, "swap": 0, "os-flavor-access:is_public": true, "name": "ds1G", "disk": 10}} {{(pid=108999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:38:14.309473 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: INFO nova.api.openstack.requestlog [None req-5335e647-a8bb-4105-912f-6b31ac608e99 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.179975 Dec 24 10:38:14.310115 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: [pid: 108999|app: 0|req: 5/11] 10.222.0.30 () {64 vars in 1282 bytes} [Fri Dec 24 10:38:14 2021] POST /compute/v2.1/flavors => generated 404 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 24 10:38:14.323079 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi [None req-9fdadbd0-c0f6-4a58-bfdf-15967be79948 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=108998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:38:14.416670 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: INFO nova.api.openstack.requestlog [None req-9fdadbd0-c0f6-4a58-bfdf-15967be79948 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.097404 Dec 24 10:38:14.417547 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: [pid: 108998|app: 0|req: 7/12] 10.222.0.30 () {64 vars in 1335 bytes} [Fri Dec 24 10:38:14 2021] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:38:17.007686 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi [None req-5335e647-a8bb-4105-912f-6b31ac608e99 admin admin] Calling method '>' {{(pid=108999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:38:17.008730 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: INFO nova.api.openstack.requestlog [None req-5335e647-a8bb-4105-912f-6b31ac608e99 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001433 Dec 24 10:38:17.009621 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: [pid: 108999|app: 0|req: 6/13] 10.222.0.30 () {54 vars in 930 bytes} [Fri Dec 24 10:38:17 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 10:38:17.081611 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi [None req-9a297afd-aec7-408b-9104-076b1ae68741 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "id": "d3", "name": "ds2G", "ram": 2048, "disk": 10, "vcpus": 2, "rxtx_factor": 1.0, "swap": 0, "os-flavor-access:is_public": true}} {{(pid=108998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:38:17.155882 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: INFO nova.api.openstack.requestlog [None req-9a297afd-aec7-408b-9104-076b1ae68741 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.139584 Dec 24 10:38:17.161169 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: [pid: 108998|app: 0|req: 8/14] 10.222.0.30 () {64 vars in 1282 bytes} [Fri Dec 24 10:38:17 2021] POST /compute/v2.1/flavors => generated 404 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 24 10:38:17.169242 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi [None req-a77cb21f-e075-4aab-9d91-ee5a1857552f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=108999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:38:17.262377 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: INFO nova.api.openstack.requestlog [None req-a77cb21f-e075-4aab-9d91-ee5a1857552f admin admin] 10.222.0.30 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.097242 Dec 24 10:38:17.263290 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: [pid: 108999|app: 0|req: 7/15] 10.222.0.30 () {64 vars in 1335 bytes} [Fri Dec 24 10:38:17 2021] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:38:19.632180 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi [None req-9a297afd-aec7-408b-9104-076b1ae68741 admin admin] Calling method '>' {{(pid=108998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:38:19.633209 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: INFO nova.api.openstack.requestlog [None req-9a297afd-aec7-408b-9104-076b1ae68741 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001423 Dec 24 10:38:19.633783 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: [pid: 108998|app: 0|req: 9/16] 10.222.0.30 () {54 vars in 930 bytes} [Fri Dec 24 10:38:19 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 10:38:19.694107 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi [None req-c0c143fc-7d81-42b3-b7e8-4d0aa241afeb admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "name": "ds4G", "vcpus": 4, "rxtx_factor": 1.0, "ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "id": "d4", "disk": 20}} {{(pid=108999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:38:19.778066 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: INFO nova.api.openstack.requestlog [None req-c0c143fc-7d81-42b3-b7e8-4d0aa241afeb admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.138199 Dec 24 10:38:19.778800 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: [pid: 108999|app: 0|req: 8/17] 10.222.0.30 () {64 vars in 1282 bytes} [Fri Dec 24 10:38:19 2021] POST /compute/v2.1/flavors => generated 404 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 24 10:38:19.791269 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi [None req-e92ac935-a168-43ab-8b43-0c3e8ac61b21 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=108998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:38:19.910726 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: INFO nova.api.openstack.requestlog [None req-e92ac935-a168-43ab-8b43-0c3e8ac61b21 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.123006 Dec 24 10:38:19.911381 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: [pid: 108998|app: 0|req: 10/18] 10.222.0.30 () {64 vars in 1335 bytes} [Fri Dec 24 10:38:19 2021] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:38:22.555566 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi [None req-c0c143fc-7d81-42b3-b7e8-4d0aa241afeb admin admin] Calling method '>' {{(pid=108999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:38:22.556603 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: INFO nova.api.openstack.requestlog [None req-c0c143fc-7d81-42b3-b7e8-4d0aa241afeb admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001482 Dec 24 10:38:22.557058 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: [pid: 108999|app: 0|req: 9/19] 10.222.0.30 () {54 vars in 930 bytes} [Fri Dec 24 10:38:22 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 10:38:22.616659 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi [None req-4e9d723b-4b1c-4d9f-9213-0f35e340d804 admin admin] Calling method '>' {{(pid=108998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:38:22.639259 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: INFO nova.api.openstack.requestlog [None req-4e9d723b-4b1c-4d9f-9213-0f35e340d804 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.074300 Dec 24 10:38:22.639796 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: [pid: 108998|app: 0|req: 11/20] 10.222.0.30 () {60 vars in 1291 bytes} [Fri Dec 24 10:38:22 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 10:38:25.068996 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi [None req-c0c143fc-7d81-42b3-b7e8-4d0aa241afeb admin admin] Calling method '>' {{(pid=108999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:38:25.070012 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: INFO nova.api.openstack.requestlog [None req-c0c143fc-7d81-42b3-b7e8-4d0aa241afeb admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001501 Dec 24 10:38:25.070422 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: [pid: 108999|app: 0|req: 10/21] 10.222.0.30 () {54 vars in 930 bytes} [Fri Dec 24 10:38:25 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 10:38:25.134090 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi [None req-7e790ca7-7792-48e8-a4eb-3f843fe0a45f admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "name": "m1.tiny", "vcpus": 1, "ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "1", "swap": 0, "rxtx_factor": 1.0, "disk": 1}} {{(pid=108998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:38:25.213356 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: INFO nova.api.openstack.requestlog [None req-7e790ca7-7792-48e8-a4eb-3f843fe0a45f admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.136544 Dec 24 10:38:25.213911 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: [pid: 108998|app: 0|req: 12/22] 10.222.0.30 () {64 vars in 1282 bytes} [Fri Dec 24 10:38:25 2021] POST /compute/v2.1/flavors => generated 402 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 24 10:38:25.226289 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi [None req-dbd93e12-4cfc-4a1e-a468-4b3d69cd6994 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=108999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:38:25.317881 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: INFO nova.api.openstack.requestlog [None req-dbd93e12-4cfc-4a1e-a468-4b3d69cd6994 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.095114 Dec 24 10:38:25.318474 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: [pid: 108999|app: 0|req: 11/23] 10.222.0.30 () {64 vars in 1332 bytes} [Fri Dec 24 10:38:25 2021] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:38:28.081386 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi [None req-7e790ca7-7792-48e8-a4eb-3f843fe0a45f admin admin] Calling method '>' {{(pid=108998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:38:28.083008 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: INFO nova.api.openstack.requestlog [None req-7e790ca7-7792-48e8-a4eb-3f843fe0a45f admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002073 Dec 24 10:38:28.083410 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: [pid: 108998|app: 0|req: 13/24] 10.222.0.30 () {54 vars in 930 bytes} [Fri Dec 24 10:38:28 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 10:38:28.140028 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi [None req-09324baf-2787-4e84-a510-03846e38bfb5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.small", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "swap": 0, "ram": 2048, "id": "2", "disk": 20}} {{(pid=108999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:38:28.213582 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: INFO nova.api.openstack.requestlog [None req-09324baf-2787-4e84-a510-03846e38bfb5 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.123811 Dec 24 10:38:28.214141 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: [pid: 108999|app: 0|req: 12/25] 10.222.0.30 () {64 vars in 1282 bytes} [Fri Dec 24 10:38:28 2021] POST /compute/v2.1/flavors => generated 405 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 24 10:38:28.226110 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi [None req-961cf4cd-6d1c-4242-94d9-d3985a0a281f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=108998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:38:28.296789 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: INFO nova.api.openstack.requestlog [None req-961cf4cd-6d1c-4242-94d9-d3985a0a281f admin admin] 10.222.0.30 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.074243 Dec 24 10:38:28.297391 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: [pid: 108998|app: 0|req: 14/26] 10.222.0.30 () {64 vars in 1332 bytes} [Fri Dec 24 10:38:28 2021] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:38:30.721877 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi [None req-09324baf-2787-4e84-a510-03846e38bfb5 admin admin] Calling method '>' {{(pid=108999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:38:30.722947 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: INFO nova.api.openstack.requestlog [None req-09324baf-2787-4e84-a510-03846e38bfb5 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001522 Dec 24 10:38:30.723363 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: [pid: 108999|app: 0|req: 13/27] 10.222.0.30 () {54 vars in 930 bytes} [Fri Dec 24 10:38:30 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 24 10:38:30.788633 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi [None req-f91ac6d9-d482-419c-bda8-23d608ad7dc5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 40, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 4096, "rxtx_factor": 1.0, "swap": 0, "vcpus": 2, "id": "3", "os-flavor-access:is_public": true, "name": "m1.medium"}} {{(pid=108998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:38:30.868014 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: INFO nova.api.openstack.requestlog [None req-f91ac6d9-d482-419c-bda8-23d608ad7dc5 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.137762 Dec 24 10:38:30.868585 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: [pid: 108998|app: 0|req: 15/28] 10.222.0.30 () {64 vars in 1282 bytes} [Fri Dec 24 10:38:30 2021] POST /compute/v2.1/flavors => generated 406 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 24 10:38:30.881162 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi [None req-97701b42-50f2-4b4d-8f61-2efeb9cb50cb admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=108999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:38:31.365036 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: INFO nova.api.openstack.requestlog [None req-97701b42-50f2-4b4d-8f61-2efeb9cb50cb admin admin] 10.222.0.30 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.487696 Dec 24 10:38:31.365620 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: [pid: 108999|app: 0|req: 14/29] 10.222.0.30 () {64 vars in 1332 bytes} [Fri Dec 24 10:38:30 2021] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 24 10:38:33.829941 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi [None req-f91ac6d9-d482-419c-bda8-23d608ad7dc5 admin admin] Calling method '>' {{(pid=108998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:38:33.831788 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: INFO nova.api.openstack.requestlog [None req-f91ac6d9-d482-419c-bda8-23d608ad7dc5 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.006377 Dec 24 10:38:33.832541 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: [pid: 108998|app: 0|req: 16/30] 10.222.0.30 () {54 vars in 930 bytes} [Fri Dec 24 10:38:33 2021] GET /compute/v2.1 => generated 388 bytes in 8 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 10:38:33.902250 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi [None req-ac087557-b848-4b1e-a347-900623177760 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "rxtx_factor": 1.0, "ram": 8192, "disk": 80, "name": "m1.large", "vcpus": 4, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "4"}} {{(pid=108999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:38:34.175462 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: INFO nova.api.openstack.requestlog [None req-ac087557-b848-4b1e-a347-900623177760 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.335863 Dec 24 10:38:34.176549 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: [pid: 108999|app: 0|req: 15/31] 10.222.0.30 () {64 vars in 1282 bytes} [Fri Dec 24 10:38:33 2021] POST /compute/v2.1/flavors => generated 405 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 24 10:38:34.188505 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi [None req-c1e89923-37d9-4981-8485-e7bfb1ad00ac admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=108998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:38:34.274378 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: INFO nova.api.openstack.requestlog [None req-c1e89923-37d9-4981-8485-e7bfb1ad00ac admin admin] 10.222.0.30 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.089435 Dec 24 10:38:34.274963 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: [pid: 108998|app: 0|req: 17/32] 10.222.0.30 () {64 vars in 1332 bytes} [Fri Dec 24 10:38:34 2021] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:38:36.856226 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi [None req-ac087557-b848-4b1e-a347-900623177760 admin admin] Calling method '>' {{(pid=108999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:38:36.857621 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: INFO nova.api.openstack.requestlog [None req-ac087557-b848-4b1e-a347-900623177760 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001534 Dec 24 10:38:36.858021 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: [pid: 108999|app: 0|req: 16/33] 10.222.0.30 () {54 vars in 930 bytes} [Fri Dec 24 10:38:36 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 10:38:36.924173 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi [None req-359d2222-22ae-4022-a9db-d6326158fb70 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "id": "5", "ram": 16384, "name": "m1.xlarge", "swap": 0, "disk": 160, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 8, "os-flavor-access:is_public": true}} {{(pid=108998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:38:37.007387 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: INFO nova.api.openstack.requestlog [None req-359d2222-22ae-4022-a9db-d6326158fb70 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.142396 Dec 24 10:38:37.008413 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: [pid: 108998|app: 0|req: 18/34] 10.222.0.30 () {64 vars in 1282 bytes} [Fri Dec 24 10:38:36 2021] POST /compute/v2.1/flavors => generated 408 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 24 10:38:37.020828 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi [None req-c027eb57-141a-4dd7-9223-1f2256ab8c4d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=108999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:38:37.106151 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: INFO nova.api.openstack.requestlog [None req-c027eb57-141a-4dd7-9223-1f2256ab8c4d admin admin] 10.222.0.30 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.089650 Dec 24 10:38:37.107124 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: [pid: 108999|app: 0|req: 17/35] 10.222.0.30 () {64 vars in 1332 bytes} [Fri Dec 24 10:38:37 2021] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:38:58.253880 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi [None req-359d2222-22ae-4022-a9db-d6326158fb70 admin admin] Calling method '>' {{(pid=108998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:38:58.254891 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: INFO nova.api.openstack.requestlog [None req-359d2222-22ae-4022-a9db-d6326158fb70 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001434 Dec 24 10:38:58.255291 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: [pid: 108998|app: 0|req: 19/36] 10.222.0.30 () {54 vars in 930 bytes} [Fri Dec 24 10:38:58 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 10:38:58.313742 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi [None req-65b1517f-4692-487e-a445-9ad55322a7a1 admin admin] Calling method '>' {{(pid=108999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:38:58.330058 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: INFO nova.api.openstack.requestlog [None req-65b1517f-4692-487e-a445-9ad55322a7a1 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.068251 Dec 24 10:38:58.330593 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: [pid: 108999|app: 0|req: 18/37] 10.222.0.30 () {60 vars in 1291 bytes} [Fri Dec 24 10:38:58 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 10:38:59.920197 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi [None req-359d2222-22ae-4022-a9db-d6326158fb70 admin admin] Calling method '>' {{(pid=108998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:38:59.921241 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: INFO nova.api.openstack.requestlog [None req-359d2222-22ae-4022-a9db-d6326158fb70 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001448 Dec 24 10:38:59.921649 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: [pid: 108998|app: 0|req: 20/38] 10.222.0.30 () {56 vars in 1074 bytes} [Fri Dec 24 10:38:59 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 10:39:00.111684 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi [None req-048b5adf-f64b-447c-a3bb-5a7829037fa1 admin admin] Calling method '>' {{(pid=108999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:39:00.117144 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: INFO nova.api.openstack.wsgi [None req-048b5adf-f64b-447c-a3bb-5a7829037fa1 admin admin] HTTP exception thrown: Flavor 42 could not be found. Dec 24 10:39:00.117711 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi [None req-048b5adf-f64b-447c-a3bb-5a7829037fa1 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=108999) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 24 10:39:00.118500 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: INFO nova.api.openstack.requestlog [None req-048b5adf-f64b-447c-a3bb-5a7829037fa1 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.058124 Dec 24 10:39:00.119011 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: [pid: 108999|app: 0|req: 19/39] 10.222.0.30 () {60 vars in 1190 bytes} [Fri Dec 24 10:39:00 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Dec 24 10:39:00.129352 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi [None req-e8fbd9bf-93f3-49ea-bd86-b0cc6dbdc3c5 admin admin] Calling method '>' {{(pid=108998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:39:00.149401 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: INFO nova.api.openstack.requestlog [None req-e8fbd9bf-93f3-49ea-bd86-b0cc6dbdc3c5 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024145 Dec 24 10:39:00.149947 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: [pid: 108998|app: 0|req: 21/40] 10.222.0.30 () {60 vars in 1210 bytes} [Fri Dec 24 10:39:00 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 10:39:00.160371 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi [None req-8c823d48-910d-4123-947e-21beff01193e admin admin] Calling method '>' {{(pid=108999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:39:00.181778 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: INFO nova.api.openstack.requestlog [None req-8c823d48-910d-4123-947e-21beff01193e admin admin] 10.222.0.30 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025514 Dec 24 10:39:00.182302 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: [pid: 108999|app: 0|req: 20/41] 10.222.0.30 () {60 vars in 1210 bytes} [Fri Dec 24 10:39:00 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 24 10:39:00.191886 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi [None req-52f392a4-92d6-48f2-b472-c69c17486f16 admin admin] Calling method '>' {{(pid=108998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:39:00.197301 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: INFO nova.api.openstack.wsgi [None req-52f392a4-92d6-48f2-b472-c69c17486f16 admin admin] HTTP exception thrown: Flavor 42 could not be found. Dec 24 10:39:00.197874 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi [None req-52f392a4-92d6-48f2-b472-c69c17486f16 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=108998) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 24 10:39:00.198664 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: INFO nova.api.openstack.requestlog [None req-52f392a4-92d6-48f2-b472-c69c17486f16 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.010309 Dec 24 10:39:00.199155 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: [pid: 108998|app: 0|req: 22/42] 10.222.0.30 () {60 vars in 1190 bytes} [Fri Dec 24 10:39:00 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Dec 24 10:39:01.673751 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi [None req-8c823d48-910d-4123-947e-21beff01193e admin admin] Calling method '>' {{(pid=108999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:39:01.674729 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: INFO nova.api.openstack.requestlog [None req-8c823d48-910d-4123-947e-21beff01193e admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001480 Dec 24 10:39:01.675130 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: [pid: 108999|app: 0|req: 21/43] 10.222.0.30 () {56 vars in 1074 bytes} [Fri Dec 24 10:39:01 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 10:39:01.866726 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi [None req-35bc4bf4-fae3-49c3-9da5-15dc3c362b5e admin admin] Calling method '>' {{(pid=108998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:39:01.872369 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: INFO nova.api.openstack.wsgi [None req-35bc4bf4-fae3-49c3-9da5-15dc3c362b5e admin admin] HTTP exception thrown: Flavor 84 could not be found. Dec 24 10:39:01.872966 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi [None req-35bc4bf4-fae3-49c3-9da5-15dc3c362b5e admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=108998) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 24 10:39:01.873751 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: INFO nova.api.openstack.requestlog [None req-35bc4bf4-fae3-49c3-9da5-15dc3c362b5e admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.058844 Dec 24 10:39:01.874251 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: [pid: 108998|app: 0|req: 23/44] 10.222.0.30 () {60 vars in 1190 bytes} [Fri Dec 24 10:39:01 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Dec 24 10:39:01.883946 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi [None req-6ea7eef4-fd9a-4e7a-966d-48f1ae0a0cf4 admin admin] Calling method '>' {{(pid=108999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:39:01.897190 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: INFO nova.api.openstack.requestlog [None req-6ea7eef4-fd9a-4e7a-966d-48f1ae0a0cf4 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.016738 Dec 24 10:39:01.897707 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: [pid: 108999|app: 0|req: 22/45] 10.222.0.30 () {60 vars in 1210 bytes} [Fri Dec 24 10:39:01 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 10:39:01.907680 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi [None req-ed0c31b5-ab2f-4fe4-927e-04eb58c83b0c admin admin] Calling method '>' {{(pid=108998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:39:01.920985 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: INFO nova.api.openstack.requestlog [None req-ed0c31b5-ab2f-4fe4-927e-04eb58c83b0c admin admin] 10.222.0.30 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017087 Dec 24 10:39:01.921598 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: [pid: 108998|app: 0|req: 24/46] 10.222.0.30 () {60 vars in 1210 bytes} [Fri Dec 24 10:39:01 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 24 10:39:01.931430 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi [None req-e653efab-fb2d-4442-a6e6-0002a43bdc30 admin admin] Calling method '>' {{(pid=108999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:39:01.936323 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: INFO nova.api.openstack.wsgi [None req-e653efab-fb2d-4442-a6e6-0002a43bdc30 admin admin] HTTP exception thrown: Flavor 84 could not be found. Dec 24 10:39:01.936921 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi [None req-e653efab-fb2d-4442-a6e6-0002a43bdc30 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=108999) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 24 10:39:01.937723 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: INFO nova.api.openstack.requestlog [None req-e653efab-fb2d-4442-a6e6-0002a43bdc30 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.009723 Dec 24 10:39:01.938202 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: [pid: 108999|app: 0|req: 23/47] 10.222.0.30 () {60 vars in 1190 bytes} [Fri Dec 24 10:39:01 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Dec 24 10:39:03.429831 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi [None req-ed0c31b5-ab2f-4fe4-927e-04eb58c83b0c admin admin] Calling method '>' {{(pid=108998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:39:03.430871 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: INFO nova.api.openstack.requestlog [None req-ed0c31b5-ab2f-4fe4-927e-04eb58c83b0c admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001455 Dec 24 10:39:03.431272 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: [pid: 108998|app: 0|req: 25/48] 10.222.0.30 () {56 vars in 1074 bytes} [Fri Dec 24 10:39:03 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 10:39:03.619747 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi [None req-ee4962e1-8e35-4c8d-b5df-d1aa919e6a49 admin admin] Calling method '>' {{(pid=108999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:39:03.624920 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: INFO nova.api.openstack.wsgi [None req-ee4962e1-8e35-4c8d-b5df-d1aa919e6a49 admin admin] HTTP exception thrown: Flavor 451 could not be found. Dec 24 10:39:03.625488 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi [None req-ee4962e1-8e35-4c8d-b5df-d1aa919e6a49 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=108999) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 24 10:39:03.626275 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: INFO nova.api.openstack.requestlog [None req-ee4962e1-8e35-4c8d-b5df-d1aa919e6a49 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.057316 Dec 24 10:39:03.626775 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: [pid: 108999|app: 0|req: 24/49] 10.222.0.30 () {60 vars in 1193 bytes} [Fri Dec 24 10:39:03 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Dec 24 10:39:03.636344 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi [None req-56508639-0784-4b6d-b8e6-d5e6f0a152e1 admin admin] Calling method '>' {{(pid=108998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:39:03.650152 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: INFO nova.api.openstack.requestlog [None req-56508639-0784-4b6d-b8e6-d5e6f0a152e1 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017156 Dec 24 10:39:03.650606 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: [pid: 108998|app: 0|req: 26/50] 10.222.0.30 () {60 vars in 1210 bytes} [Fri Dec 24 10:39:03 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 10:39:03.662207 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi [None req-bb93be7d-8280-4983-bf72-de85b741bf2c admin admin] Calling method '>' {{(pid=108999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:39:03.675050 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: INFO nova.api.openstack.requestlog [None req-bb93be7d-8280-4983-bf72-de85b741bf2c admin admin] 10.222.0.30 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017759 Dec 24 10:39:03.675555 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: [pid: 108999|app: 0|req: 25/51] 10.222.0.30 () {60 vars in 1210 bytes} [Fri Dec 24 10:39:03 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 24 10:39:03.684927 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi [None req-fc33adbb-42ed-4c57-8dbb-aeb546108d0e admin admin] Calling method '>' {{(pid=108998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:39:03.689919 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: INFO nova.api.openstack.wsgi [None req-fc33adbb-42ed-4c57-8dbb-aeb546108d0e admin admin] HTTP exception thrown: Flavor 451 could not be found. Dec 24 10:39:03.690482 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi [None req-fc33adbb-42ed-4c57-8dbb-aeb546108d0e admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=108998) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 24 10:39:03.691264 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: INFO nova.api.openstack.requestlog [None req-fc33adbb-42ed-4c57-8dbb-aeb546108d0e admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.009729 Dec 24 10:39:03.692171 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: [pid: 108998|app: 0|req: 27/52] 10.222.0.30 () {60 vars in 1193 bytes} [Fri Dec 24 10:39:03 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Dec 24 10:39:05.163336 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi [None req-bb93be7d-8280-4983-bf72-de85b741bf2c admin admin] Calling method '>' {{(pid=108999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:39:05.164346 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: INFO nova.api.openstack.requestlog [None req-bb93be7d-8280-4983-bf72-de85b741bf2c admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001423 Dec 24 10:39:05.165048 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: [pid: 108999|app: 0|req: 26/53] 10.222.0.30 () {56 vars in 1074 bytes} [Fri Dec 24 10:39:05 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 10:39:05.353112 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi [None req-b0a7f8e9-1625-4e8e-aa83-08e14e167505 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=108998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:39:05.477632 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: INFO nova.api.openstack.requestlog [None req-b0a7f8e9-1625-4e8e-aa83-08e14e167505 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.175205 Dec 24 10:39:05.478174 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: [pid: 108998|app: 0|req: 28/54] 10.222.0.30 () {64 vars in 1235 bytes} [Fri Dec 24 10:39:05 2021] POST /compute/v2.1/flavors => generated 404 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 24 10:39:06.951724 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi [None req-bb93be7d-8280-4983-bf72-de85b741bf2c admin admin] Calling method '>' {{(pid=108999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:39:06.953346 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: INFO nova.api.openstack.requestlog [None req-bb93be7d-8280-4983-bf72-de85b741bf2c admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001397 Dec 24 10:39:06.953737 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: [pid: 108999|app: 0|req: 27/55] 10.222.0.30 () {56 vars in 1074 bytes} [Fri Dec 24 10:39:06 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 10:39:07.143295 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi [None req-43fa1ac8-9853-4902-83c1-ea3cc510e9a4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=108998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:39:07.231359 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: INFO nova.api.openstack.requestlog [None req-43fa1ac8-9853-4902-83c1-ea3cc510e9a4 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.140470 Dec 24 10:39:07.231917 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: [pid: 108998|app: 0|req: 29/56] 10.222.0.30 () {64 vars in 1235 bytes} [Fri Dec 24 10:39:07 2021] POST /compute/v2.1/flavors => generated 405 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 24 10:39:08.691315 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi [None req-bb93be7d-8280-4983-bf72-de85b741bf2c admin admin] Calling method '>' {{(pid=108999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:39:08.692318 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: INFO nova.api.openstack.requestlog [None req-bb93be7d-8280-4983-bf72-de85b741bf2c admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001414 Dec 24 10:39:08.695920 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: [pid: 108999|app: 0|req: 28/57] 10.222.0.30 () {56 vars in 1074 bytes} [Fri Dec 24 10:39:08 2021] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 10:39:08.883035 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi [None req-41437c20-cb0f-4a69-8d18-ff5ee0163a5f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=108998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:39:08.971497 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: INFO nova.api.openstack.requestlog [None req-41437c20-cb0f-4a69-8d18-ff5ee0163a5f admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.139022 Dec 24 10:39:08.971938 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: [pid: 108998|app: 0|req: 30/58] 10.222.0.30 () {64 vars in 1235 bytes} [Fri Dec 24 10:39:08 2021] POST /compute/v2.1/flavors => generated 407 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 24 10:39:10.445069 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi [None req-bb93be7d-8280-4983-bf72-de85b741bf2c admin admin] Calling method '>' {{(pid=108999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:39:10.446057 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: INFO nova.api.openstack.requestlog [None req-bb93be7d-8280-4983-bf72-de85b741bf2c admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001460 Dec 24 10:39:10.446442 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: [pid: 108999|app: 0|req: 29/59] 10.222.0.30 () {56 vars in 1074 bytes} [Fri Dec 24 10:39:10 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 10:39:10.636377 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi [None req-9a27ba35-675b-4f0d-92b6-a3c8c4534a0e admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=108998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:39:10.718682 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: INFO nova.api.openstack.requestlog [None req-9a27ba35-675b-4f0d-92b6-a3c8c4534a0e admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.131902 Dec 24 10:39:10.719143 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: [pid: 108998|app: 0|req: 31/60] 10.222.0.30 () {64 vars in 1235 bytes} [Fri Dec 24 10:39:10 2021] POST /compute/v2.1/flavors => generated 409 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 24 10:39:12.198129 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi [None req-bb93be7d-8280-4983-bf72-de85b741bf2c admin admin] Calling method '>' {{(pid=108999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:39:12.199163 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: INFO nova.api.openstack.requestlog [None req-bb93be7d-8280-4983-bf72-de85b741bf2c admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001435 Dec 24 10:39:12.199554 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: [pid: 108999|app: 0|req: 30/61] 10.222.0.30 () {56 vars in 1074 bytes} [Fri Dec 24 10:39:12 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 10:39:12.388716 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi [None req-189eef4b-e4aa-4da4-91f1-da062453bcc6 admin admin] Calling method '>' {{(pid=108998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:39:12.407770 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: INFO nova.api.openstack.requestlog [None req-189eef4b-e4aa-4da4-91f1-da062453bcc6 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.069080 Dec 24 10:39:12.408235 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: [pid: 108998|app: 0|req: 32/62] 10.222.0.30 () {60 vars in 1202 bytes} [Fri Dec 24 10:39:12 2021] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 24 10:40:00.281410 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi [None req-bb93be7d-8280-4983-bf72-de85b741bf2c admin admin] Calling method '>' {{(pid=108999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:40:00.282419 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: INFO nova.api.openstack.requestlog [None req-bb93be7d-8280-4983-bf72-de85b741bf2c admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001478 Dec 24 10:40:00.282815 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: [pid: 108999|app: 0|req: 31/63] 10.222.0.30 () {54 vars in 930 bytes} [Fri Dec 24 10:40:00 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 10:40:00.339583 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi [None req-016fd5c0-582f-4697-8d6d-44de5f788ba8 admin admin] Calling method '>' {{(pid=108998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:40:00.359128 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: INFO nova.api.openstack.requestlog [None req-016fd5c0-582f-4697-8d6d-44de5f788ba8 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.069738 Dec 24 10:40:00.359643 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: [pid: 108998|app: 0|req: 33/64] 10.222.0.30 () {60 vars in 1291 bytes} [Fri Dec 24 10:40:00 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 10:40:00.381526 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi [None req-cf6f6401-1df2-4631-944c-07921926d870 admin admin] Calling method '>' {{(pid=108999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:40:00.389080 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: INFO nova.api.openstack.requestlog [None req-cf6f6401-1df2-4631-944c-07921926d870 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011079 Dec 24 10:40:00.389594 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: [pid: 108999|app: 0|req: 32/65] 10.222.0.30 () {60 vars in 1282 bytes} [Fri Dec 24 10:40:00 2021] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:40:00.400797 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi [None req-66b5a52e-14e7-4d6f-8df4-f454aef40426 admin admin] Calling method '>' {{(pid=108998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:40:00.408102 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: INFO nova.api.openstack.requestlog [None req-66b5a52e-14e7-4d6f-8df4-f454aef40426 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010640 Dec 24 10:40:00.408603 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: [pid: 108998|app: 0|req: 34/66] 10.222.0.30 () {60 vars in 1285 bytes} [Fri Dec 24 10:40:00 2021] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:40:00.420215 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi [None req-481eeb4b-b37d-48dc-958b-f44aa9531c77 admin admin] Calling method '>' {{(pid=108999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:40:00.427512 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: INFO nova.api.openstack.requestlog [None req-481eeb4b-b37d-48dc-958b-f44aa9531c77 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011097 Dec 24 10:40:00.429532 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: [pid: 108999|app: 0|req: 33/67] 10.222.0.30 () {60 vars in 1285 bytes} [Fri Dec 24 10:40:00 2021] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:40:00.439626 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi [None req-a26559c8-3f3e-4240-aba6-553419a19d9d admin admin] Calling method '>' {{(pid=108998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:40:00.446829 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: INFO nova.api.openstack.requestlog [None req-a26559c8-3f3e-4240-aba6-553419a19d9d admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010576 Dec 24 10:40:00.447333 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: [pid: 108998|app: 0|req: 35/68] 10.222.0.30 () {60 vars in 1282 bytes} [Fri Dec 24 10:40:00 2021] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 24 10:41:33.988408 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi [None req-3e157ba1-93c6-4f9c-9e41-7c91bb9bdffe tempest-verify_tempest_config-1502483168 tempest-verify_tempest_config-1502483168-project] Calling method '>' {{(pid=108999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:41:33.990385 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: INFO nova.api.openstack.requestlog [None req-3e157ba1-93c6-4f9c-9e41-7c91bb9bdffe tempest-verify_tempest_config-1502483168 tempest-verify_tempest_config-1502483168-project] 10.222.0.30 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.101544 Dec 24 10:41:33.990937 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: [pid: 108999|app: 0|req: 34/69] 10.222.0.30 () {58 vars in 1133 bytes} [Fri Dec 24 10:41:33 2021] GET /compute/v2.1/extensions => generated 22700 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 24 10:43:05.004735 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi [None req-a26559c8-3f3e-4240-aba6-553419a19d9d admin admin] Calling method '>' {{(pid=108998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:43:05.005804 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: INFO nova.api.openstack.requestlog [None req-a26559c8-3f3e-4240-aba6-553419a19d9d admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001487 Dec 24 10:43:05.006197 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: [pid: 108998|app: 0|req: 36/70] 10.222.0.30 () {56 vars in 1074 bytes} [Fri Dec 24 10:43:05 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 10:43:05.262864 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi [None req-c3262fd6-0f2f-443f-b83b-bf2385cffd01 admin admin] Calling method '>' {{(pid=108999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:43:05.264071 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 10:43:05.264071 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: warnings.warn(msg) Dec 24 10:43:05.265648 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG oslo_concurrency.lockutils [None req-c3262fd6-0f2f-443f-b83b-bf2385cffd01 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:43:05.266126 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG oslo_concurrency.lockutils [None req-c3262fd6-0f2f-443f-b83b-bf2385cffd01 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:43:05.266939 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG oslo_concurrency.lockutils [None req-c3262fd6-0f2f-443f-b83b-bf2385cffd01 admin admin] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:43:05.267371 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG oslo_concurrency.lockutils [None req-c3262fd6-0f2f-443f-b83b-bf2385cffd01 admin admin] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:43:05.299936 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: INFO nova.api.openstack.requestlog [None req-c3262fd6-0f2f-443f-b83b-bf2385cffd01 admin admin] 10.222.0.30 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.147997 Dec 24 10:43:05.300482 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: [pid: 108999|app: 0|req: 35/71] 10.222.0.30 () {60 vars in 1193 bytes} [Fri Dec 24 10:43:05 2021] GET /compute/v2.1/os-services => generated 791 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 24 10:43:06.779738 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi [None req-a26559c8-3f3e-4240-aba6-553419a19d9d admin admin] Calling method '>' {{(pid=108998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:43:06.780732 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: INFO nova.api.openstack.requestlog [None req-a26559c8-3f3e-4240-aba6-553419a19d9d admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001405 Dec 24 10:43:06.781170 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: [pid: 108998|app: 0|req: 37/72] 10.222.0.30 () {56 vars in 1074 bytes} [Fri Dec 24 10:43:06 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 10:43:06.973100 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi [None req-29197c96-e880-42b9-8c7d-fd87ae6bfaca admin admin] Calling method '>' {{(pid=108999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:43:06.974295 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 10:43:06.974295 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: warnings.warn(msg) Dec 24 10:43:06.975857 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG oslo_concurrency.lockutils [None req-29197c96-e880-42b9-8c7d-fd87ae6bfaca admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:43:06.976311 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG oslo_concurrency.lockutils [None req-29197c96-e880-42b9-8c7d-fd87ae6bfaca admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:43:06.977157 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG oslo_concurrency.lockutils [None req-29197c96-e880-42b9-8c7d-fd87ae6bfaca admin admin] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:43:06.977622 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG oslo_concurrency.lockutils [None req-29197c96-e880-42b9-8c7d-fd87ae6bfaca admin admin] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:43:06.996281 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: INFO nova.api.openstack.requestlog [None req-29197c96-e880-42b9-8c7d-fd87ae6bfaca admin admin] 10.222.0.30 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.073803 Dec 24 10:43:06.996759 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: [pid: 108999|app: 0|req: 36/73] 10.222.0.30 () {60 vars in 1193 bytes} [Fri Dec 24 10:43:06 2021] GET /compute/v2.1/os-services => generated 791 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 24 10:43:18.947336 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi [None req-a26559c8-3f3e-4240-aba6-553419a19d9d admin admin] Calling method '>' {{(pid=108998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:43:18.948323 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: INFO nova.api.openstack.requestlog [None req-a26559c8-3f3e-4240-aba6-553419a19d9d admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001430 Dec 24 10:43:18.948713 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: [pid: 108998|app: 0|req: 38/74] 10.222.0.30 () {56 vars in 1074 bytes} [Fri Dec 24 10:43:18 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 10:43:19.144672 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi [None req-fbd9c250-1894-4204-ad22-0e7f659d3b89 admin admin] Calling method '>' {{(pid=108999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:43:19.145893 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 10:43:19.145893 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: warnings.warn(msg) Dec 24 10:43:19.147830 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG oslo_concurrency.lockutils [None req-fbd9c250-1894-4204-ad22-0e7f659d3b89 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:43:19.148284 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG oslo_concurrency.lockutils [None req-fbd9c250-1894-4204-ad22-0e7f659d3b89 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:43:19.149505 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG oslo_concurrency.lockutils [None req-fbd9c250-1894-4204-ad22-0e7f659d3b89 admin admin] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:43:19.150481 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG oslo_concurrency.lockutils [None req-fbd9c250-1894-4204-ad22-0e7f659d3b89 admin admin] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:43:19.177681 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: INFO nova.api.openstack.requestlog [None req-fbd9c250-1894-4204-ad22-0e7f659d3b89 admin admin] 10.222.0.30 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.087600 Dec 24 10:43:19.178219 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: [pid: 108999|app: 0|req: 37/75] 10.222.0.30 () {60 vars in 1193 bytes} [Fri Dec 24 10:43:19 2021] GET /compute/v2.1/os-services => generated 1035 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 10:43:20.664337 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: DEBUG nova.api.openstack.wsgi [None req-a26559c8-3f3e-4240-aba6-553419a19d9d admin admin] Calling method '>' {{(pid=108998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:43:20.665383 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: INFO nova.api.openstack.requestlog [None req-a26559c8-3f3e-4240-aba6-553419a19d9d admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001448 Dec 24 10:43:20.665778 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: [pid: 108998|app: 0|req: 39/76] 10.222.0.30 () {56 vars in 1074 bytes} [Fri Dec 24 10:43:20 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 10:43:20.857334 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG nova.api.openstack.wsgi [None req-ef3176f3-594a-44b8-81f7-9fdc6cc39148 admin admin] Calling method '>' {{(pid=108999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:43:20.858485 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 10:43:20.858485 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: warnings.warn(msg) Dec 24 10:43:20.860034 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG oslo_concurrency.lockutils [None req-ef3176f3-594a-44b8-81f7-9fdc6cc39148 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:43:20.860476 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG oslo_concurrency.lockutils [None req-ef3176f3-594a-44b8-81f7-9fdc6cc39148 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:43:20.861327 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG oslo_concurrency.lockutils [None req-ef3176f3-594a-44b8-81f7-9fdc6cc39148 admin admin] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:43:20.861756 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: DEBUG oslo_concurrency.lockutils [None req-ef3176f3-594a-44b8-81f7-9fdc6cc39148 admin admin] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:43:20.882756 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: INFO nova.api.openstack.requestlog [None req-ef3176f3-594a-44b8-81f7-9fdc6cc39148 admin admin] 10.222.0.30 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.076686 Dec 24 10:43:20.883229 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: [pid: 108999|app: 0|req: 38/77] 10.222.0.30 () {60 vars in 1193 bytes} [Fri Dec 24 10:43:20 2021] GET /compute/v2.1/os-services => generated 1035 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 10:44:18.210802 dv-cinder-816443-3-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Dec 24 10:44:18.211318 dv-cinder-816443-3-iscsi devstack@n-api.service[108997]: Fri Dec 24 10:44:18 2021 - graceful shutdown triggered... Dec 24 10:44:18.211765 dv-cinder-816443-3-iscsi devstack@n-api.service[108998]: Gracefully killing worker 1 (pid: 108998)... Dec 24 10:44:18.212159 dv-cinder-816443-3-iscsi devstack@n-api.service[108999]: Gracefully killing worker 2 (pid: 108999)... Dec 24 10:44:19.211311 dv-cinder-816443-3-iscsi devstack@n-api.service[108997]: worker 1 buried after 1 seconds Dec 24 10:44:19.211879 dv-cinder-816443-3-iscsi devstack@n-api.service[108997]: worker 2 buried after 1 seconds Dec 24 10:44:19.211879 dv-cinder-816443-3-iscsi devstack@n-api.service[108997]: goodbye to uWSGI. Dec 24 10:44:19.212943 dv-cinder-816443-3-iscsi systemd[1]: devstack@n-api.service: Succeeded. Dec 24 10:44:19.213498 dv-cinder-816443-3-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Dec 24 10:44:19.216278 dv-cinder-816443-3-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Dec 24 10:44:19.227102 dv-cinder-816443-3-iscsi devstack@n-api.service[123411]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Dec 24 10:44:19.229837 dv-cinder-816443-3-iscsi devstack@n-api.service[123411]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Dec 24 10:44:19 2021] *** Dec 24 10:44:19.229837 dv-cinder-816443-3-iscsi devstack@n-api.service[123411]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Dec 24 10:44:19.229837 dv-cinder-816443-3-iscsi devstack@n-api.service[123411]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Dec 24 10:44:19.229837 dv-cinder-816443-3-iscsi devstack@n-api.service[123411]: nodename: dv-cinder-816443-3-iscsi Dec 24 10:44:19.229837 dv-cinder-816443-3-iscsi devstack@n-api.service[123411]: machine: x86_64 Dec 24 10:44:19.229837 dv-cinder-816443-3-iscsi devstack@n-api.service[123411]: clock source: unix Dec 24 10:44:19.229837 dv-cinder-816443-3-iscsi devstack@n-api.service[123411]: pcre jit disabled Dec 24 10:44:19.229837 dv-cinder-816443-3-iscsi devstack@n-api.service[123411]: detected number of CPU cores: 4 Dec 24 10:44:19.229837 dv-cinder-816443-3-iscsi devstack@n-api.service[123411]: current working directory: / Dec 24 10:44:19.229837 dv-cinder-816443-3-iscsi devstack@n-api.service[123411]: detected binary path: /usr/bin/uwsgi-core Dec 24 10:44:19.229837 dv-cinder-816443-3-iscsi devstack@n-api.service[123411]: your processes number limit is 47680 Dec 24 10:44:19.229837 dv-cinder-816443-3-iscsi devstack@n-api.service[123411]: your memory page size is 4096 bytes Dec 24 10:44:19.229837 dv-cinder-816443-3-iscsi devstack@n-api.service[123411]: detected max file descriptor number: 2048 Dec 24 10:44:19.229837 dv-cinder-816443-3-iscsi devstack@n-api.service[123411]: lock engine: pthread robust mutexes Dec 24 10:44:19.230763 dv-cinder-816443-3-iscsi devstack@n-api.service[123411]: thunder lock: enabled Dec 24 10:44:19.230763 dv-cinder-816443-3-iscsi devstack@n-api.service[123411]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Dec 24 10:44:19.230763 dv-cinder-816443-3-iscsi devstack@n-api.service[123411]: Python version: 3.8.10 (default, Nov 26 2021, 20:14:08) [GCC 9.3.0] Dec 24 10:44:19.274393 dv-cinder-816443-3-iscsi devstack@n-api.service[123411]: Python main interpreter initialized at 0x55dfb69769c0 Dec 24 10:44:19.274393 dv-cinder-816443-3-iscsi devstack@n-api.service[123411]: python threads support enabled Dec 24 10:44:19.274393 dv-cinder-816443-3-iscsi devstack@n-api.service[123411]: your server socket listen backlog is limited to 100 connections Dec 24 10:44:19.274393 dv-cinder-816443-3-iscsi devstack@n-api.service[123411]: your mercy for graceful operations on workers is 90 seconds Dec 24 10:44:19.274834 dv-cinder-816443-3-iscsi devstack@n-api.service[123411]: mapped 403077 bytes (393 KB) for 2 cores Dec 24 10:44:19.274834 dv-cinder-816443-3-iscsi devstack@n-api.service[123411]: *** Operational MODE: preforking *** Dec 24 10:44:19.279652 dv-cinder-816443-3-iscsi devstack@n-api.service[123411]: *** uWSGI is running in multiple interpreter mode *** Dec 24 10:44:19.279652 dv-cinder-816443-3-iscsi devstack@n-api.service[123411]: spawned uWSGI master process (pid: 123411) Dec 24 10:44:19.279652 dv-cinder-816443-3-iscsi devstack@n-api.service[123411]: spawned uWSGI worker 1 (pid: 123431, cores: 1) Dec 24 10:44:19.279652 dv-cinder-816443-3-iscsi devstack@n-api.service[123411]: spawned uWSGI worker 2 (pid: 123432, cores: 1) Dec 24 10:44:19.279652 dv-cinder-816443-3-iscsi devstack@n-api.service[123411]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Dec 24 10:44:19.275571 dv-cinder-816443-3-iscsi systemd[1]: Started Devstack devstack@n-api.service. Dec 24 10:44:21.161949 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 24 10:44:21.161949 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: from cryptography.utils import int_from_bytes Dec 24 10:44:21.162625 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 24 10:44:21.162625 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: from cryptography.utils import int_from_bytes Dec 24 10:44:21.176388 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 24 10:44:21.176388 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: from cryptography.utils import int_from_bytes Dec 24 10:44:21.176932 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 24 10:44:21.176932 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: from cryptography.utils import int_from_bytes Dec 24 10:44:23.564563 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Dec 24 10:44:23.565179 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Dec 24 10:44:23.565268 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Dec 24 10:44:23.565602 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Dec 24 10:44:23.565856 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Dec 24 10:44:23.566255 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:44:23.566580 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:44:23.566902 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:44:23.567219 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:44:23.567546 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:44:23.567852 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:44:23.568173 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:44:23.568491 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:44:23.568878 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:44:23.569145 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:44:23.569489 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:44:23.569813 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-816443-3-iscsi {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:44:23.570914 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:44:23.570914 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:44:23.570914 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:44:23.571139 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:44:23.571422 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:44:23.571754 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:44:23.572077 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:44:23.572600 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:44:23.574009 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:44:23.574009 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:44:23.574009 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:44:23.574282 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:44:23.574588 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:44:23.574919 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:44:23.575219 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:44:23.575529 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:44:23.575855 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:44:23.576189 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:44:23.576568 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-816443-3-iscsi {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:44:23.576926 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:44:23.577228 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:44:23.577542 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:44:23.577964 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:44:23.578203 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Dec 24 10:44:23.578874 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:44:23.579093 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Dec 24 10:44:23.579315 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:44:23.579509 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Dec 24 10:44:23.579691 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:44:23.579865 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Dec 24 10:44:23.580018 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:44:23.580199 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Dec 24 10:44:23.580431 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:44:23.580587 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:44:23.580743 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:44:23.580951 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:44:23.581104 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:44:23.581248 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:44:23.581434 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:44:23.581590 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:44:23.581759 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:44:23.581759 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:44:23.582336 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:44:23.582533 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:44:23.582683 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:44:23.582831 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:44:23.582982 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:44:23.583182 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:44:23.583333 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:44:23.583648 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:44:23.583813 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:44:23.583966 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:44:23.584110 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:44:23.584277 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:44:23.584387 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:44:23.584479 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:44:23.584563 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-816443-3-iscsi {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:44:23.584674 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:44:23.584760 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:44:23.584873 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:44:23.585475 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:44:23.585585 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:44:23.585682 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:44:23.585766 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:44:23.585864 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:44:23.585955 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:44:23.586053 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:44:23.586147 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:44:23.586232 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:44:23.586321 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:44:23.586404 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:44:23.586510 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:44:23.586510 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:44:23.586687 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:44:23.586790 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:44:23.586876 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:44:23.586964 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:44:23.587061 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:44:23.587190 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:44:23.587326 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:44:23.587497 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:44:23.587663 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:44:23.587828 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:44:23.588016 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:44:23.588172 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:44:23.588312 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:44:23.588457 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:44:23.588609 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:44:23.588760 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:44:23.589029 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:44:23.589180 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:44:23.589321 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:44:23.589472 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:44:23.589625 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:44:23.589779 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:44:23.589919 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-816443-3-iscsi {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:44:23.590068 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.30 {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:44:23.590237 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:44:23.590378 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.30 {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:44:23.590552 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:44:23.590689 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:44:23.590869 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:44:23.591025 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:44:23.591195 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:44:23.591341 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:44:23.591488 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:44:23.591630 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:44:23.591806 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:44:23.591954 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:44:23.592128 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:44:23.592270 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:44:23.592418 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:44:23.592562 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:44:23.592722 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:44:23.592890 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:44:23.593064 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:44:23.593215 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:44:23.593383 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:44:23.593524 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:44:23.593704 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:44:23.593845 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:44:23.593988 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:44:23.594141 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:44:23.594287 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:44:23.594425 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:44:23.594571 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:44:23.594711 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:44:23.594866 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:44:23.595013 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:44:23.595158 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:44:23.595296 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:44:23.595441 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:44:23.595578 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:44:23.595731 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:44:23.595881 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:44:23.596021 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:44:23.596160 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:44:23.596319 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:44:23.596488 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:44:23.596634 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:44:23.596793 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:44:23.596974 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:44:23.597115 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:44:23.597265 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:44:23.597429 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:44:23.597646 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:44:23.597953 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:44:23.598133 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:44:23.598228 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:44:23.598319 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:44:23.598413 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:44:23.598505 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:44:23.598599 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:44:23.598682 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:44:23.598764 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:44:23.598894 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:44:23.598999 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:44:23.599212 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:44:23.599313 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:44:23.599533 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:44:23.599634 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:44:23.599838 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:44:23.599938 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:44:23.600141 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:44:23.600241 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:44:23.600444 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:44:23.600542 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:44:23.601319 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:44:23.601433 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:44:23.601646 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:44:23.601752 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:44:23.601950 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:44:23.602052 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:44:23.602256 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:44:23.602355 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:44:23.602571 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:44:23.602678 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:44:23.602872 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:44:23.602969 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:44:23.603174 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:44:23.603292 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.30 {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:44:23.603491 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:44:23.603597 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.30 {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:44:23.603797 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:44:23.603888 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:44:23.604101 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:44:23.604193 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:44:23.604419 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:44:23.604512 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:44:23.604717 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:44:23.604809 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:44:23.605047 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:44:23.605155 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:44:23.605365 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:44:23.605494 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:44:23.605675 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:44:23.605773 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:44:23.605976 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:44:23.606075 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:44:23.606278 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:44:23.606382 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:44:23.606634 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:44:23.606727 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:44:23.606969 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:44:23.607066 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:44:23.607338 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:44:23.607665 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:44:23.607986 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:44:23.608159 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:44:23.608306 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:44:23.608458 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:44:23.608603 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:44:23.608744 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:44:23.608956 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:44:23.609117 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:44:23.609271 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:44:23.609438 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:44:23.609581 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:44:23.609733 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:44:23.609881 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:44:23.610024 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:44:23.610173 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:44:23.610326 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:44:23.610478 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.610629 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:44:23.610777 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:44:23.610918 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.611068 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:44:23.611251 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.611522 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:44:23.611692 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.611846 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:44:23.611996 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.612155 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:44:23.612304 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.612454 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:44:23.612604 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.612754 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:44:23.612926 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.613083 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:44:23.613225 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.613378 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:44:23.613527 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.613682 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:44:23.613831 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.614015 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:44:23.614113 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.614207 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:44:23.614299 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.614390 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:44:23.614584 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.614691 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:44:23.614934 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.615026 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:44:23.615317 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.615465 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:44:23.615654 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:44:23.615745 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.615969 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:44:23.616135 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.616368 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:44:23.616493 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.616675 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:44:23.616774 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.617013 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:44:23.617118 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.617338 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:44:23.617444 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.617712 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:44:23.617814 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.618012 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:44:23.618152 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.618378 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:44:23.618488 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.618686 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:44:23.618824 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.619037 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:44:23.619194 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.619361 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:44:23.619601 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.619693 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:44:23.619997 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.620103 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:44:23.620324 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.620423 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:44:23.620640 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.620732 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:44:23.620979 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.621089 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:44:23.621293 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.621386 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:44:23.621594 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:44:23.621683 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.621900 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:44:23.621993 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.622201 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:44:23.622297 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.622523 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:44:23.622624 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.622848 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:44:23.622940 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.623157 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:44:23.623249 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.623462 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.623552 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:44:23.623811 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:44:23.623929 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.624064 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.624157 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 10:44:23.624373 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.624466 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.624675 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.624775 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.625024 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.625142 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.625355 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.625458 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.625665 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.625776 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.625995 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.626097 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.626298 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.626398 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.626606 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.626714 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.626912 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.627011 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.627214 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.627322 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.627523 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.627630 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.627828 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.627948 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.628128 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.628229 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.628449 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.628558 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.628755 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.628899 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.629155 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.629255 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.629476 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.629584 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.629780 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.629891 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.630082 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.630251 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.630396 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.630509 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.630704 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.630805 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.631013 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.631115 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.631322 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.631424 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.631645 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.631736 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.632014 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.632120 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.632326 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.632418 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.632661 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.632760 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.633014 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.633122 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.633315 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.633413 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.633637 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.633730 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.633950 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.634053 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.634260 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.634354 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.634561 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.634661 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.634868 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.634961 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.635171 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.635264 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.635478 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.635585 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.635780 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.635880 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.636084 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.636187 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.636384 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.636484 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.636685 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.636778 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.637013 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.637106 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.637319 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.637433 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.637618 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.637710 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.637937 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.638042 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.638273 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.638385 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.638621 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.638743 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.638965 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.639104 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.639945 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.640059 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.640133 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.640211 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.640287 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.640365 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.640434 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.640512 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.640612 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.640780 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.640955 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.641039 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.641267 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.641348 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.641575 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.641664 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.641888 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.641969 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.642198 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.642287 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.642503 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.642592 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.643740 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.643856 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.643948 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.644045 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.644125 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.644203 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.644278 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.644354 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.644447 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.644540 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.644631 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.644721 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.644805 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.645840 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.645949 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.646023 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.646101 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.646178 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.646256 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.646347 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.646498 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.646584 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.646673 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.646757 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.646838 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.646928 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.647019 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.647110 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.647277 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.647385 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.648148 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.648288 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.648459 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.648586 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.648772 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.648923 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.649106 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.649216 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.649421 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.649522 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.649730 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.649829 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.650040 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.650132 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.650599 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.650696 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.650905 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.651004 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.651213 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.651306 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.651518 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.651609 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.651824 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.651928 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.652150 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.652265 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.652458 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.652556 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.652761 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.652871 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.653094 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.653187 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.653400 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.653493 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.653737 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.653837 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.654043 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.654130 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.654359 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.654456 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.654669 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.654770 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.654977 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.655076 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.655288 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.655387 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.655593 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.655698 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.655908 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.656006 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.656209 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.656309 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.656523 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.656620 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.656852 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.656957 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.657171 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.657263 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.657487 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.657579 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.657799 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.657889 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.658109 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.658230 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.658417 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.658516 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.658719 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.658810 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.659028 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.659124 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.659351 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.659451 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.659655 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.659747 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.659973 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.660065 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.660292 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.660384 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.660595 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.660695 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.660922 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.661038 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.661248 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.661341 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.661556 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.661648 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.661861 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.661967 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.662163 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.662265 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.662466 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.662566 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.662813 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.662921 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.663169 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.663768 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.663977 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.664078 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.664294 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.664399 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.664613 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.664700 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.664946 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.665055 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.665261 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.665367 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.665570 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.665671 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.665877 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.665976 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.666181 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.666280 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.666495 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.666589 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.666802 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.666892 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.667113 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.667215 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.667422 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.667521 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.667731 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.667873 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.668040 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.668146 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.668351 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.668447 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.669039 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.669148 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.669148 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.669321 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.669405 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.669487 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.669577 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.669676 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.669881 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.669974 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.670195 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.670295 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.670509 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.670773 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.670866 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.671152 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.671241 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.671470 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.671552 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.671784 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.671876 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.672197 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.672522 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.672758 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.672913 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.673146 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.673272 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.673467 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.673590 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.673797 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.673893 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.674116 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.674208 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.674448 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.674540 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.674856 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.674961 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.675078 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.675159 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.675383 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.675477 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.675689 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.675780 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.675999 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.676087 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.676305 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.676384 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.676604 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.676699 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.676938 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.677044 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.677278 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.677367 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.677586 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.677691 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.677965 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.678067 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.678190 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.678273 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.678516 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.678604 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.678908 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.679004 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.679221 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.679311 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.679528 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.679609 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.679833 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.679922 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.680137 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.680226 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.680441 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.680538 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.680785 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.680917 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.681130 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.681229 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.681469 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.681580 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.681843 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.681951 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.682178 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.682268 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.682537 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.682675 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.682859 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.682968 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.683191 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.683291 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.683490 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.683582 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.683791 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.683884 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.684094 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.684192 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.684403 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.684503 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.684711 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.685050 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.685156 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.685429 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.685601 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.685755 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.685862 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.686061 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.686160 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.686434 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.686577 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.686901 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.687222 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.687342 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.687552 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.687673 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.687867 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.687971 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.688175 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.688264 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.688479 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.688580 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.688779 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.688919 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.689124 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.689225 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.689488 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.689593 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.689860 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.689986 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.690181 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.690288 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.690532 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.690636 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.690890 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.691057 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.691205 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.691321 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.691557 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.691699 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.692046 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.692239 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.692440 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.692582 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.692833 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.693145 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.693265 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.693507 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.693622 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.693879 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.693990 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.694191 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.694302 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.694523 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.694616 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.694833 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.694928 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.695141 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.695253 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.695450 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.695558 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.695759 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.695861 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.696066 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.696160 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.696386 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.696500 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.696691 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.696793 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.697306 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.697424 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.697520 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.697612 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.697738 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.697839 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.698045 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.698138 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.698352 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.698493 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.698717 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.698815 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.698940 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.699035 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.699241 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.699344 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.699542 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.699681 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.699844 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.699943 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.700159 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.700259 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.700466 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.700556 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.700807 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.701104 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.701206 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.701308 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.701393 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.701478 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.701705 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.701798 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.702005 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.702098 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.702314 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.702412 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.702618 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.702711 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.702934 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.703035 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.703243 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.703343 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.703548 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.703648 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.703851 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.703944 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.704160 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.704251 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.704462 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.704555 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.704764 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.704890 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.705101 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.705209 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.705412 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.705531 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.705709 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.705802 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.706014 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.706106 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.706317 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.706419 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.706624 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.706716 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.706932 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.707023 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.707240 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.707344 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.707544 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.707636 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.707872 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.707964 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.708174 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.708283 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.708479 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.708583 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.708783 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.708969 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.709111 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.709216 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.709417 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.709519 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.709721 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.709859 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.710558 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.710654 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.710871 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.710971 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.711179 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.711271 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.711487 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.711605 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.711800 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.711907 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.712109 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.712210 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.712416 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.712508 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.712724 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.712907 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.713060 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.713165 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.713386 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.713480 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.713690 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.713781 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.713990 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.714100 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.714291 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.714395 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.714696 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.714795 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.715020 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.715121 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.715373 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.716055 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.716386 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.716651 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.716806 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.717026 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.717134 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.717299 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.717392 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.717621 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.717728 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.717945 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.718044 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.718266 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.718419 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.718583 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.718750 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.718878 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.719016 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.719164 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.719311 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.719642 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.719755 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.719931 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.720026 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.720785 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.720932 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.721022 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.721107 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.721181 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.721181 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.721474 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.721778 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.721886 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.722128 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.722335 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.722431 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.722750 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.722838 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.723111 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.723213 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.723431 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.723541 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.723746 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.723853 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.724049 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.724149 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.724362 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.724461 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.724678 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.724771 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.725014 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.725116 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.725325 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.725432 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.726185 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.726321 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.726509 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.726639 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.726825 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.727064 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.727158 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.727378 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.727483 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.727691 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.727784 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.728021 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.728118 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.728336 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.728428 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.728647 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.728737 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.728977 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.729070 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.729294 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.729393 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.729604 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.729699 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.729915 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.730013 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.730227 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.730323 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.730537 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.730635 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.730846 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.730952 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.731153 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.731242 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.731474 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.731596 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.731799 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.731904 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.732114 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.732207 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.732438 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.732530 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.732837 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.732944 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.733155 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.733255 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.733474 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.733566 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.733794 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.733901 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.734103 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.734196 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.734408 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.734527 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.734709 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.734843 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.735018 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.735158 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.735323 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.735473 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.735626 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.735779 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.735949 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.736085 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.736251 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.737061 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.737172 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.737261 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.737357 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.737451 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.737543 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.737635 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.737732 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.737825 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.737910 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.738005 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.738090 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.739190 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.739290 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.739377 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.739460 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.739460 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.739624 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.739767 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.739907 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.740050 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.740149 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.740281 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.740382 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.740477 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.740562 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.740652 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.740743 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.740853 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.740987 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.741088 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.741256 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.741417 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.741585 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.741764 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.741893 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.742068 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.742208 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.742388 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.742519 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.742721 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.742847 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.743053 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.743160 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.743365 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.743469 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.743774 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.743873 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.744113 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.744213 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.744483 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.744624 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.744800 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.744950 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.745147 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.745264 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.745460 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.745587 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.745768 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.745889 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.746108 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.746225 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.746415 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.746543 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.746725 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.746853 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.747030 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.747150 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.747337 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.747464 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.747639 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.747757 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.747941 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.748100 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.748229 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.748357 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.748554 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.748673 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.749481 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.749594 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.749758 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.749898 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.750037 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.750169 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.750265 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.750396 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.750502 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.750596 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.750688 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.750773 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.750773 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.750946 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.751070 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.751161 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.751290 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.751382 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.751615 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.751720 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.751932 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.752023 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.752257 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.752350 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.752563 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.752665 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.756865 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.756993 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.757090 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.757170 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.757243 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.757334 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.757408 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.757480 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.757557 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.757637 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.757723 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.757809 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.757890 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.757963 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.758034 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.758104 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.758182 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.758255 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.758326 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.758395 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.758475 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.758548 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.758633 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.758707 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.758707 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.758845 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.758916 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.758994 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.759076 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.759149 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.759220 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.759296 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.759378 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.759468 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.759555 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.759627 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.759698 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.759767 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.759837 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.759944 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.760046 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.760137 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.760223 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.760302 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.760389 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.760480 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.760563 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.760635 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.760713 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.760795 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.760934 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.761011 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.761109 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.761191 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.761272 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.761634 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.761750 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.761858 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.761957 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.762035 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.762205 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.762310 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.762452 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.762639 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.762767 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.762955 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.763059 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.763259 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.763411 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.763572 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.763721 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.763885 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.764062 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.764197 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.764381 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.764494 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.764806 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.764930 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.765245 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.765347 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.765423 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.765494 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.765887 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.766126 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.766213 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.766295 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.766369 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.766447 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.766622 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.766719 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.767491 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.767593 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.767670 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.767747 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.767820 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.767890 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.767975 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.768056 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.768129 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.768207 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.769114 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.769209 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.769299 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.769381 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.769455 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.769532 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.769614 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.769700 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.770444 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.770548 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.770631 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.770712 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.770785 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.770866 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.770966 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.771048 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.771129 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.771208 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.771819 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.771936 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.772013 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.772097 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.772181 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.772293 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.772379 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.773080 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.778516 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.778627 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.778705 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.778786 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.778905 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.778982 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.779062 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.779135 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.779205 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.779288 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.779370 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.779443 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.779443 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.779571 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.779642 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.779730 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.779812 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.779892 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.779964 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.780045 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.780128 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.780208 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.780288 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.780360 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.780438 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.780517 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.780590 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.780673 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.780747 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.782474 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.782574 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.782649 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.782737 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.782824 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.782907 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.782987 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.783067 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.783163 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.783251 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.783820 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.783906 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.783981 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.784060 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.784133 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.784133 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.784274 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.784346 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.784425 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.784504 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.785212 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.785295 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.785368 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.785448 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.785522 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.785593 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.785678 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.785760 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.785834 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.786339 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.786339 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.786487 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.786570 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.786658 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.786738 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.786811 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.786882 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.786953 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.787033 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.787107 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.787177 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.787248 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.787326 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.787407 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.787480 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.787550 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.787627 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.787711 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.787783 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.787869 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.787942 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.788013 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.788135 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.788700 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.788781 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.788893 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.788970 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.789042 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.789113 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.789192 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.789271 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.789357 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.789431 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.789502 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.789571 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.789650 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.789799 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.789799 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.791440 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.791616 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.791772 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.792266 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.792442 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.792442 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.792735 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.792934 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.793093 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.793257 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.793440 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.793669 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.793837 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.794002 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.794177 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.794333 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.794497 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.794680 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.794906 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.795067 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.795228 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.795394 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.795556 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.795712 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.795867 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.795867 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.795867 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.795867 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.795867 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.795867 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.795867 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.795867 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.797169 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.797169 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.797169 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.797169 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.797169 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.797169 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.798088 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.798088 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.798088 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.798543 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.798706 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.798863 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.799026 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.799183 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.799344 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.799501 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.799655 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.799818 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.799988 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.800161 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.800324 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.800481 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.800635 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.800792 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.800985 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.801143 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.801297 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.801452 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.801606 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.801776 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.801940 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.802451 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.802628 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.802785 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.802947 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.803114 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.803278 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.803436 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.803589 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.803857 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.804021 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.804191 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.804347 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.804503 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.804664 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.804878 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.805121 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.805299 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.805456 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.805620 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.805775 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.805931 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.806098 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.806254 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.806409 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.806566 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.806728 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.806896 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.807062 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.807227 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.807390 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.807547 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.807708 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.807878 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.808059 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.808224 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.808387 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.808557 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.808714 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.808900 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.809080 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.809238 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.809596 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.809780 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.809945 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.809945 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.810253 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.810416 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.810572 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.810728 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.810890 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.811053 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.811227 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.811392 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.811392 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.818085 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.818085 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.818463 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.818646 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.818807 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.818966 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.819133 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.819303 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.819494 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.819651 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.819821 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.819992 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.820164 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.820336 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.820501 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.820658 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.820917 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.821087 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.821257 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.821430 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.821595 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.821752 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.821926 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.822083 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.822249 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.822433 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.823144 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.823322 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.823480 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.823637 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.823808 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.823808 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.824104 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.824266 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.824432 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.824608 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.824780 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.824966 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.825123 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.825277 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.825478 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.826135 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.826303 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.826460 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.826615 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.826615 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.826929 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.827102 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.827278 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.827441 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.827608 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.827785 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.827949 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.828120 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.828276 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.828276 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.828572 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.828726 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.828929 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.829106 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=123432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Dec 24 10:44:23.829287 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.829287 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.829287 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.829287 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.829287 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.829287 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.829287 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.829287 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.830548 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.830548 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.830548 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.830548 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.830548 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.830548 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.830548 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.830548 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.831779 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.831779 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.831779 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.831779 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.831779 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.831779 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.831779 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.831779 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.839590 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.839590 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.839590 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.839590 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.839590 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.839590 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.839590 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.839590 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.841514 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.841514 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.841514 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.841514 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.841514 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.841514 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.841514 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.841514 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.842723 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.842723 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.842723 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.842723 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.842723 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.842723 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.842723 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.842723 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.843901 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.843901 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.843901 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.843901 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.843901 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.843901 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.843901 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.843901 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.845144 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.845144 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.845144 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.845144 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 10:44:23.845144 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=123431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Dec 24 10:44:23.845883 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_db.sqlalchemy.engines [None req-407410c2-8b2c-4382-9389-72a073b84a06 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123432) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 24 10:44:23.862047 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_db.sqlalchemy.engines [None req-798694b1-3a72-45ed-b5e6-7679cbc3e5eb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123431) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 24 10:44:23.915212 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.context [None req-407410c2-8b2c-4382-9389-72a073b84a06 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),bfb47192-5c7e-4e04-9bc9-d8065be13f1d(cell1) {{(pid=123432) load_cells /opt/stack/nova/nova/context.py:464}} Dec 24 10:44:23.918482 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-407410c2-8b2c-4382-9389-72a073b84a06 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:44:23.920215 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-407410c2-8b2c-4382-9389-72a073b84a06 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:44:23.921065 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-407410c2-8b2c-4382-9389-72a073b84a06 None None] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:44:23.923011 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-407410c2-8b2c-4382-9389-72a073b84a06 None None] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:44:23.930545 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.context [None req-798694b1-3a72-45ed-b5e6-7679cbc3e5eb None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),bfb47192-5c7e-4e04-9bc9-d8065be13f1d(cell1) {{(pid=123431) load_cells /opt/stack/nova/nova/context.py:464}} Dec 24 10:44:23.934884 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-798694b1-3a72-45ed-b5e6-7679cbc3e5eb None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:44:23.936222 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_db.sqlalchemy.engines [None req-407410c2-8b2c-4382-9389-72a073b84a06 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123432) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 24 10:44:23.936521 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-798694b1-3a72-45ed-b5e6-7679cbc3e5eb None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:44:23.937397 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-798694b1-3a72-45ed-b5e6-7679cbc3e5eb None None] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:44:23.937840 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_db.sqlalchemy.engines [None req-407410c2-8b2c-4382-9389-72a073b84a06 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123432) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 24 10:44:23.939384 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-798694b1-3a72-45ed-b5e6-7679cbc3e5eb None None] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:44:23.952931 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_db.sqlalchemy.engines [None req-798694b1-3a72-45ed-b5e6-7679cbc3e5eb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123431) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 24 10:44:23.954807 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_db.sqlalchemy.engines [None req-798694b1-3a72-45ed-b5e6-7679cbc3e5eb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123431) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 24 10:44:24.102399 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_db.sqlalchemy.engines [None req-407410c2-8b2c-4382-9389-72a073b84a06 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123432) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 24 10:44:24.118781 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_db.sqlalchemy.engines [None req-798694b1-3a72-45ed-b5e6-7679cbc3e5eb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123431) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 24 10:44:24.419728 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: WARNING keystonemiddleware.auth_token [None req-407410c2-8b2c-4382-9389-72a073b84a06 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 24 10:44:24.427011 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: WARNING keystonemiddleware.auth_token [None req-407410c2-8b2c-4382-9389-72a073b84a06 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 24 10:44:24.438337 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: WARNING keystonemiddleware.auth_token [None req-798694b1-3a72-45ed-b5e6-7679cbc3e5eb None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 24 10:44:24.445507 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: WARNING keystonemiddleware.auth_token [None req-798694b1-3a72-45ed-b5e6-7679cbc3e5eb None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 24 10:44:24.770955 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: WARNING keystonemiddleware.auth_token [None req-407410c2-8b2c-4382-9389-72a073b84a06 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 24 10:44:24.776390 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: WARNING keystonemiddleware.auth_token [None req-407410c2-8b2c-4382-9389-72a073b84a06 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 24 10:44:24.781791 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55dfb69769c0 pid: 123432 (default app) Dec 24 10:44:24.793451 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: WARNING keystonemiddleware.auth_token [None req-798694b1-3a72-45ed-b5e6-7679cbc3e5eb None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 24 10:44:24.798774 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: WARNING keystonemiddleware.auth_token [None req-798694b1-3a72-45ed-b5e6-7679cbc3e5eb None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 24 10:44:24.804740 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55dfb69769c0 pid: 123431 (default app) Dec 24 10:44:58.997688 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-fc144261-cc04-4271-98c8-7b8d93c7539c tempest-VolumesGetTestJSON-1189542889 tempest-VolumesGetTestJSON-1189542889-project] Action: 'create', calling method: .version_select at 0x7f189ba41e50>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1117993094", "metadata": {"Type": "work"}}} {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:45:01.300626 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-bcd34755-69be-4b8d-9192-6861a6cf4087 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-359657024", "imageRef": "fae8172d-77c4-4f40-905a-7285c185448c", "flavorRef": "452", "networks": [{"uuid": "8016a0c6-9874-4e24-99d5-a347d449be0f"}]}} {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:45:01.586252 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-fc144261-cc04-4271-98c8-7b8d93c7539c tempest-VolumesGetTestJSON-1189542889 tempest-VolumesGetTestJSON-1189542889-project] 10.222.0.30 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 3.651159 Dec 24 10:45:01.588065 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 1/1] 10.222.0.30 () {60 vars in 1155 bytes} [Fri Dec 24 10:44:57 2021] POST /compute/v2.1/os-volumes => generated 353 bytes in 3655 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Dec 24 10:45:01.601234 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-d88ea690-8d08-442a-8f3b-f3abff6c83e9 tempest-VolumesGetTestJSON-1189542889 tempest-VolumesGetTestJSON-1189542889-project] Calling method '.version_select at 0x7f189b9149d0>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:45:01.701887 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.network.neutron [None req-bcd34755-69be-4b8d-9192-6861a6cf4087 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] validate_networks() for [('8016a0c6-9874-4e24-99d5-a347d449be0f', None, None, None, None, None)] {{(pid=123431) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 24 10:45:01.794727 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-d88ea690-8d08-442a-8f3b-f3abff6c83e9 tempest-VolumesGetTestJSON-1189542889 tempest-VolumesGetTestJSON-1189542889-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/0cc7812e-813d-496a-85ee-32e7c04761e6" status: 200 len: 353 microversion: 2.1 time: 0.198702 Dec 24 10:45:01.795552 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 2/2] 10.222.0.30 () {58 vars in 1244 bytes} [Fri Dec 24 10:45:01 2021] GET /compute/v2.1/os-volumes/0cc7812e-813d-496a-85ee-32e7c04761e6 => generated 353 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 10:45:01.922115 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-59521790-a937-420c-bb39-4742401d87cf tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1650878459", "imageRef": "fae8172d-77c4-4f40-905a-7285c185448c", "flavorRef": "452", "networks": [{"uuid": "228fc74c-3c3c-4fc8-adc4-224176487fa2"}]}} {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:45:02.105449 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.network.neutron [None req-59521790-a937-420c-bb39-4742401d87cf tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] validate_networks() for [('228fc74c-3c3c-4fc8-adc4-224176487fa2', None, None, None, None, None)] {{(pid=123432) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 24 10:45:02.780630 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.virt.hardware [None req-bcd34755-69be-4b8d-9192-6861a6cf4087 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Flavor limits 0:0:0 {{(pid=123431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 24 10:45:02.781369 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.virt.hardware [None req-bcd34755-69be-4b8d-9192-6861a6cf4087 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Image limits 0:0:0 {{(pid=123431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 24 10:45:02.782514 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.virt.hardware [None req-bcd34755-69be-4b8d-9192-6861a6cf4087 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Flavor pref 0:0:0 {{(pid=123431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 24 10:45:02.782961 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.virt.hardware [None req-bcd34755-69be-4b8d-9192-6861a6cf4087 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Image pref 0:0:0 {{(pid=123431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 24 10:45:02.783868 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.virt.hardware [None req-bcd34755-69be-4b8d-9192-6861a6cf4087 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 24 10:45:02.799712 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-bcd34755-69be-4b8d-9192-6861a6cf4087 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:45:02.800151 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-bcd34755-69be-4b8d-9192-6861a6cf4087 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:45:02.802556 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-bcd34755-69be-4b8d-9192-6861a6cf4087 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:45:02.803025 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-bcd34755-69be-4b8d-9192-6861a6cf4087 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:45:02.837273 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.quota [None req-bcd34755-69be-4b8d-9192-6861a6cf4087 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Getting quotas for project e62d11172cdf4959a15ac1ffc5601aca. Resources: {'instances', 'cores', 'ram'} {{(pid=123431) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 24 10:45:02.844224 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.quota [None req-bcd34755-69be-4b8d-9192-6861a6cf4087 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Getting quotas for user 5ad5096717dc425c849dfe95ea55a6af and project e62d11172cdf4959a15ac1ffc5601aca. Resources: {'instances', 'cores', 'ram'} {{(pid=123431) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 24 10:45:02.858076 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-bcd34755-69be-4b8d-9192-6861a6cf4087 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Going to run 1 instances... {{(pid=123431) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 24 10:45:02.862416 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-bcd34755-69be-4b8d-9192-6861a6cf4087 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] [instance: b18ab8db-0c1f-4343-ae07-953fc820b211] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fae8172d-77c4-4f40-905a-7285c185448c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123431) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 24 10:45:03.060662 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-bcd34755-69be-4b8d-9192-6861a6cf4087 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.951707 Dec 24 10:45:03.061945 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 1/3] 10.222.0.30 () {60 vars in 1146 bytes} [Fri Dec 24 10:45:00 2021] POST /compute/v2.1/servers => generated 380 bytes in 2955 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 24 10:45:03.067811 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-51b229da-0684-4f20-a4a9-9cd5979fe387 tempest-VolumesGetTestJSON-1189542889 tempest-VolumesGetTestJSON-1189542889-project] Calling method '.version_select at 0x7f189b03f820>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:45:03.208329 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-51b229da-0684-4f20-a4a9-9cd5979fe387 tempest-VolumesGetTestJSON-1189542889 tempest-VolumesGetTestJSON-1189542889-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/0cc7812e-813d-496a-85ee-32e7c04761e6" status: 200 len: 354 microversion: 2.1 time: 0.144753 Dec 24 10:45:03.209814 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 2/4] 10.222.0.30 () {58 vars in 1244 bytes} [Fri Dec 24 10:45:03 2021] GET /compute/v2.1/os-volumes/0cc7812e-813d-496a-85ee-32e7c04761e6 => generated 354 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 10:45:03.222759 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-163b01d2-4c22-42d5-aecf-8044d7c813bf tempest-VolumesTestJSON-458040589 tempest-VolumesTestJSON-458040589-project] Calling method '.version_select at 0x7f189b03fee0>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:45:03.330350 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-163b01d2-4c22-42d5-aecf-8044d7c813bf tempest-VolumesTestJSON-458040589 tempest-VolumesTestJSON-458040589-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/7f903f48-338f-42c8-b8b3-d57e31f6bbba" status: 200 len: 351 microversion: 2.1 time: 0.111630 Dec 24 10:45:03.337611 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 3/5] 10.222.0.30 () {58 vars in 1244 bytes} [Fri Dec 24 10:45:03 2021] GET /compute/v2.1/os-volumes/7f903f48-338f-42c8-b8b3-d57e31f6bbba => generated 351 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 10:45:03.342559 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-d95eb3e0-cd2f-4638-8899-7e3cf8520ddf tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:45:03.350950 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-d95eb3e0-cd2f-4638-8899-7e3cf8520ddf tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] [instance: b18ab8db-0c1f-4343-ae07-953fc820b211] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:45:03.527751 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.virt.hardware [None req-59521790-a937-420c-bb39-4742401d87cf tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] Flavor limits 0:0:0 {{(pid=123432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 24 10:45:03.528191 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.virt.hardware [None req-59521790-a937-420c-bb39-4742401d87cf tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] Image limits 0:0:0 {{(pid=123432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 24 10:45:03.528634 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.virt.hardware [None req-59521790-a937-420c-bb39-4742401d87cf tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] Flavor pref 0:0:0 {{(pid=123432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 24 10:45:03.529070 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.virt.hardware [None req-59521790-a937-420c-bb39-4742401d87cf tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] Image pref 0:0:0 {{(pid=123432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 24 10:45:03.529546 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.virt.hardware [None req-59521790-a937-420c-bb39-4742401d87cf tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 24 10:45:03.558533 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-59521790-a937-420c-bb39-4742401d87cf tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:45:03.559467 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-59521790-a937-420c-bb39-4742401d87cf tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:45:03.560509 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-59521790-a937-420c-bb39-4742401d87cf tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:45:03.561291 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-59521790-a937-420c-bb39-4742401d87cf tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:45:03.579345 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-d95eb3e0-cd2f-4638-8899-7e3cf8520ddf tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ad5096717dc425c849dfe95ea55a6af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62d11172cdf4959a15ac1ffc5601aca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:45:03.603776 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-d95eb3e0-cd2f-4638-8899-7e3cf8520ddf tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] 10.222.0.30 "GET /compute/v2.1/servers/b18ab8db-0c1f-4343-ae07-953fc820b211" status: 200 len: 1217 microversion: 2.1 time: 0.263886 Dec 24 10:45:03.608698 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 4/6] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:45:03 2021] GET /compute/v2.1/servers/b18ab8db-0c1f-4343-ae07-953fc820b211 => generated 1217 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:45:03.609382 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.quota [None req-59521790-a937-420c-bb39-4742401d87cf tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] Getting quotas for project 52385c4779dd49e7b3f0d9e56a8d2d26. Resources: {'instances', 'cores', 'ram'} {{(pid=123432) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 24 10:45:03.613942 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-d07ff4de-a8cd-4a09-97e6-170bee6dca6c tempest-VolumesGetTestJSON-1189542889 tempest-VolumesGetTestJSON-1189542889-project] Calling method '.version_select at 0x7f189a7b7ca0>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:45:03.629609 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.quota [None req-59521790-a937-420c-bb39-4742401d87cf tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] Getting quotas for user f75a06733f5d4b7e8044fe6a9914a5db and project 52385c4779dd49e7b3f0d9e56a8d2d26. Resources: {'instances', 'cores', 'ram'} {{(pid=123432) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 24 10:45:03.664004 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-59521790-a937-420c-bb39-4742401d87cf tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] Going to run 1 instances... {{(pid=123432) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 24 10:45:03.673445 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-59521790-a937-420c-bb39-4742401d87cf tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] [instance: f77538c5-1e85-4d4f-b6cb-1c003149fac1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fae8172d-77c4-4f40-905a-7285c185448c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123432) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 24 10:45:03.701708 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-d07ff4de-a8cd-4a09-97e6-170bee6dca6c tempest-VolumesGetTestJSON-1189542889 tempest-VolumesGetTestJSON-1189542889-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/0cc7812e-813d-496a-85ee-32e7c04761e6" status: 200 len: 354 microversion: 2.1 time: 0.091689 Dec 24 10:45:03.705225 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 5/7] 10.222.0.30 () {58 vars in 1244 bytes} [Fri Dec 24 10:45:03 2021] GET /compute/v2.1/os-volumes/0cc7812e-813d-496a-85ee-32e7c04761e6 => generated 354 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 10:45:03.714247 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-5ea5df51-892f-4e4b-b01d-f1fcc0494037 tempest-VolumesGetTestJSON-1189542889 tempest-VolumesGetTestJSON-1189542889-project] Calling method '.version_select at 0x7f189a7b7940>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:45:03.866926 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-59521790-a937-420c-bb39-4742401d87cf tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.070238 Dec 24 10:45:03.867628 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 3/8] 10.222.0.30 () {60 vars in 1146 bytes} [Fri Dec 24 10:45:01 2021] POST /compute/v2.1/servers => generated 380 bytes in 2072 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 24 10:45:03.887626 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-d14feb4f-7ae3-4eaa-9671-da461add1162 tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:45:03.888357 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-d14feb4f-7ae3-4eaa-9671-da461add1162 tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] [instance: f77538c5-1e85-4d4f-b6cb-1c003149fac1] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:45:04.061479 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-d14feb4f-7ae3-4eaa-9671-da461add1162 tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75a06733f5d4b7e8044fe6a9914a5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52385c4779dd49e7b3f0d9e56a8d2d26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:45:04.084399 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-d14feb4f-7ae3-4eaa-9671-da461add1162 tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] 10.222.0.30 "GET /compute/v2.1/servers/f77538c5-1e85-4d4f-b6cb-1c003149fac1" status: 200 len: 1215 microversion: 2.1 time: 0.207939 Dec 24 10:45:04.086648 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 4/9] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:45:03 2021] GET /compute/v2.1/servers/f77538c5-1e85-4d4f-b6cb-1c003149fac1 => generated 1215 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:45:04.310496 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-5ea5df51-892f-4e4b-b01d-f1fcc0494037 tempest-VolumesGetTestJSON-1189542889 tempest-VolumesGetTestJSON-1189542889-project] 10.222.0.30 "DELETE /compute/v2.1/os-volumes/0cc7812e-813d-496a-85ee-32e7c04761e6" status: 202 len: 0 microversion: 2.1 time: 0.600066 Dec 24 10:45:04.313032 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 6/10] 10.222.0.30 () {58 vars in 1247 bytes} [Fri Dec 24 10:45:03 2021] DELETE /compute/v2.1/os-volumes/0cc7812e-813d-496a-85ee-32e7c04761e6 => generated 0 bytes in 604 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 24 10:45:04.323691 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-3866e70d-45f6-4860-9d36-ceaec3853a2f tempest-VolumesGetTestJSON-1189542889 tempest-VolumesGetTestJSON-1189542889-project] Calling method '.version_select at 0x7f189afad820>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:45:04.489074 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-3866e70d-45f6-4860-9d36-ceaec3853a2f tempest-VolumesGetTestJSON-1189542889 tempest-VolumesGetTestJSON-1189542889-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/0cc7812e-813d-496a-85ee-32e7c04761e6" status: 200 len: 353 microversion: 2.1 time: 0.171952 Dec 24 10:45:04.489734 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 5/11] 10.222.0.30 () {58 vars in 1244 bytes} [Fri Dec 24 10:45:04 2021] GET /compute/v2.1/os-volumes/0cc7812e-813d-496a-85ee-32e7c04761e6 => generated 353 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 10:45:04.625177 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-322eeba6-f9d3-4759-8b48-1b2e08a644ef tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:45:04.626552 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-322eeba6-f9d3-4759-8b48-1b2e08a644ef tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] [instance: b18ab8db-0c1f-4343-ae07-953fc820b211] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:45:04.715394 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-322eeba6-f9d3-4759-8b48-1b2e08a644ef tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ad5096717dc425c849dfe95ea55a6af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62d11172cdf4959a15ac1ffc5601aca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:45:04.724987 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-322eeba6-f9d3-4759-8b48-1b2e08a644ef tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] 10.222.0.30 "GET /compute/v2.1/servers/b18ab8db-0c1f-4343-ae07-953fc820b211" status: 200 len: 1217 microversion: 2.1 time: 0.105373 Dec 24 10:45:04.736169 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 7/12] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:45:04 2021] GET /compute/v2.1/servers/b18ab8db-0c1f-4343-ae07-953fc820b211 => generated 1217 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:45:05.102163 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-f40c83da-9042-4c78-a6bc-1de6a815b225 tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:45:05.102813 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-f40c83da-9042-4c78-a6bc-1de6a815b225 tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] [instance: f77538c5-1e85-4d4f-b6cb-1c003149fac1] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:45:05.163165 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-f40c83da-9042-4c78-a6bc-1de6a815b225 tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75a06733f5d4b7e8044fe6a9914a5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52385c4779dd49e7b3f0d9e56a8d2d26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:45:05.172463 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-f40c83da-9042-4c78-a6bc-1de6a815b225 tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] 10.222.0.30 "GET /compute/v2.1/servers/f77538c5-1e85-4d4f-b6cb-1c003149fac1" status: 200 len: 1215 microversion: 2.1 time: 0.074528 Dec 24 10:45:05.173958 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 6/13] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:45:05 2021] GET /compute/v2.1/servers/f77538c5-1e85-4d4f-b6cb-1c003149fac1 => generated 1215 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:45:05.490022 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-05391f63-ceaf-461f-b645-4797e6860cc9 tempest-VolumesTestJSON-458040589 tempest-VolumesTestJSON-458040589-project] Calling method '.version_select at 0x7f189a7e2940>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:45:05.505613 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-f8157f4a-7cfc-479f-afb3-18607b788447 tempest-VolumesGetTestJSON-1189542889 tempest-VolumesGetTestJSON-1189542889-project] Calling method '.version_select at 0x7f189afd1ca0>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:45:05.576680 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.wsgi [None req-f8157f4a-7cfc-479f-afb3-18607b788447 tempest-VolumesGetTestJSON-1189542889 tempest-VolumesGetTestJSON-1189542889-project] HTTP exception thrown: Volume 0cc7812e-813d-496a-85ee-32e7c04761e6 could not be found. Dec 24 10:45:05.577386 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-f8157f4a-7cfc-479f-afb3-18607b788447 tempest-VolumesGetTestJSON-1189542889 tempest-VolumesGetTestJSON-1189542889-project] Returning 404 to user: Volume 0cc7812e-813d-496a-85ee-32e7c04761e6 could not be found. {{(pid=123432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 24 10:45:05.579366 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-f8157f4a-7cfc-479f-afb3-18607b788447 tempest-VolumesGetTestJSON-1189542889 tempest-VolumesGetTestJSON-1189542889-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/0cc7812e-813d-496a-85ee-32e7c04761e6" status: 404 len: 109 microversion: 2.1 time: 0.079996 Dec 24 10:45:05.579953 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 7/14] 10.222.0.30 () {58 vars in 1244 bytes} [Fri Dec 24 10:45:05 2021] GET /compute/v2.1/os-volumes/0cc7812e-813d-496a-85ee-32e7c04761e6 => generated 109 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 24 10:45:05.585595 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-05391f63-ceaf-461f-b645-4797e6860cc9 tempest-VolumesTestJSON-458040589 tempest-VolumesTestJSON-458040589-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/db4a5b36-1b31-42bd-8e69-daf6cc88f9e5" status: 200 len: 351 microversion: 2.1 time: 0.099947 Dec 24 10:45:05.591987 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 8/15] 10.222.0.30 () {58 vars in 1244 bytes} [Fri Dec 24 10:45:05 2021] GET /compute/v2.1/os-volumes/db4a5b36-1b31-42bd-8e69-daf6cc88f9e5 => generated 351 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 10:45:05.753079 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-dade5288-b6f9-4bdf-8868-e9542c283afc tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:45:05.754417 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-dade5288-b6f9-4bdf-8868-e9542c283afc tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] [instance: b18ab8db-0c1f-4343-ae07-953fc820b211] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:45:05.808950 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-dade5288-b6f9-4bdf-8868-e9542c283afc tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:45:05.810959 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-dade5288-b6f9-4bdf-8868-e9542c283afc tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:45:05.819250 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-dade5288-b6f9-4bdf-8868-e9542c283afc tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:45:05.823237 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-dade5288-b6f9-4bdf-8868-e9542c283afc tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:45:06.191512 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-9a355f46-1d90-4f3c-a6eb-4d097ccef667 tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:45:06.192424 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-9a355f46-1d90-4f3c-a6eb-4d097ccef667 tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] [instance: f77538c5-1e85-4d4f-b6cb-1c003149fac1] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:45:06.201726 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-9a355f46-1d90-4f3c-a6eb-4d097ccef667 tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:45:06.205484 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-9a355f46-1d90-4f3c-a6eb-4d097ccef667 tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:45:06.209848 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-9a355f46-1d90-4f3c-a6eb-4d097ccef667 tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:45:06.209848 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-9a355f46-1d90-4f3c-a6eb-4d097ccef667 tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:45:06.493293 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-dade5288-b6f9-4bdf-8868-e9542c283afc tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ad5096717dc425c849dfe95ea55a6af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62d11172cdf4959a15ac1ffc5601aca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:45:06.516217 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-dade5288-b6f9-4bdf-8868-e9542c283afc tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] 10.222.0.30 "GET /compute/v2.1/servers/b18ab8db-0c1f-4343-ae07-953fc820b211" status: 200 len: 1221 microversion: 2.1 time: 0.774406 Dec 24 10:45:06.519718 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 8/16] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:45:05 2021] GET /compute/v2.1/servers/b18ab8db-0c1f-4343-ae07-953fc820b211 => generated 1221 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:45:06.881000 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-9a355f46-1d90-4f3c-a6eb-4d097ccef667 tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75a06733f5d4b7e8044fe6a9914a5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52385c4779dd49e7b3f0d9e56a8d2d26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:45:06.894745 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-9a355f46-1d90-4f3c-a6eb-4d097ccef667 tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] 10.222.0.30 "GET /compute/v2.1/servers/f77538c5-1e85-4d4f-b6cb-1c003149fac1" status: 200 len: 1219 microversion: 2.1 time: 0.707848 Dec 24 10:45:06.898886 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 9/17] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:45:06 2021] GET /compute/v2.1/servers/f77538c5-1e85-4d4f-b6cb-1c003149fac1 => generated 1219 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 24 10:45:07.582985 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-5f8c4e99-3a50-4904-a90d-0ccbd2bd808e tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:45:07.582985 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-5f8c4e99-3a50-4904-a90d-0ccbd2bd808e tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] [instance: b18ab8db-0c1f-4343-ae07-953fc820b211] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:45:07.582985 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-5f8c4e99-3a50-4904-a90d-0ccbd2bd808e tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:45:07.582985 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-5f8c4e99-3a50-4904-a90d-0ccbd2bd808e tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:45:07.584359 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-5f8c4e99-3a50-4904-a90d-0ccbd2bd808e tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:45:07.584359 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-5f8c4e99-3a50-4904-a90d-0ccbd2bd808e tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:45:07.636492 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-5f8c4e99-3a50-4904-a90d-0ccbd2bd808e tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ad5096717dc425c849dfe95ea55a6af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62d11172cdf4959a15ac1ffc5601aca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:45:07.646016 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-5f8c4e99-3a50-4904-a90d-0ccbd2bd808e tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] 10.222.0.30 "GET /compute/v2.1/servers/b18ab8db-0c1f-4343-ae07-953fc820b211" status: 200 len: 1213 microversion: 2.1 time: 0.114181 Dec 24 10:45:07.648087 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-9581e1ed-bbf0-4bce-b5ea-155d21f38854 tempest-VolumesTestJSON-458040589 tempest-VolumesTestJSON-458040589-project] Calling method '.version_select at 0x7f189a763940>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:45:07.653324 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 9/18] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:45:07 2021] GET /compute/v2.1/servers/b18ab8db-0c1f-4343-ae07-953fc820b211 => generated 1213 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:45:07.709498 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-9581e1ed-bbf0-4bce-b5ea-155d21f38854 tempest-VolumesTestJSON-458040589 tempest-VolumesTestJSON-458040589-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/4d916c30-a69d-4f8f-88b8-480867e42497" status: 200 len: 350 microversion: 2.1 time: 0.066018 Dec 24 10:45:07.710133 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 10/19] 10.222.0.30 () {58 vars in 1244 bytes} [Fri Dec 24 10:45:07 2021] GET /compute/v2.1/os-volumes/4d916c30-a69d-4f8f-88b8-480867e42497 => generated 350 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 24 10:45:07.722223 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-7554f65b-be98-40fc-b15c-ca9d86b9394a tempest-VolumesTestJSON-458040589 tempest-VolumesTestJSON-458040589-project] Calling method '.version_select at 0x7f189a6fd310>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:45:07.911509 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-1b6ae1f3-fdfc-4a2f-b240-e00a6558dc1d tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:45:07.912754 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-1b6ae1f3-fdfc-4a2f-b240-e00a6558dc1d tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] [instance: f77538c5-1e85-4d4f-b6cb-1c003149fac1] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:45:07.931180 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-7554f65b-be98-40fc-b15c-ca9d86b9394a tempest-VolumesTestJSON-458040589 tempest-VolumesTestJSON-458040589-project] 10.222.0.30 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.212408 Dec 24 10:45:07.931867 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 10/20] 10.222.0.30 () {58 vars in 1133 bytes} [Fri Dec 24 10:45:07 2021] GET /compute/v2.1/os-volumes => generated 1035 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:45:07.945343 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-f109ced4-8c84-4b76-a78b-909842a759fa tempest-VolumesTestJSON-458040589 tempest-VolumesTestJSON-458040589-project] Calling method '.version_select at 0x7f189a717310>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:45:07.951935 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-1b6ae1f3-fdfc-4a2f-b240-e00a6558dc1d tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:45:07.953370 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-1b6ae1f3-fdfc-4a2f-b240-e00a6558dc1d tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:45:07.955939 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-1b6ae1f3-fdfc-4a2f-b240-e00a6558dc1d tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:45:07.956636 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-1b6ae1f3-fdfc-4a2f-b240-e00a6558dc1d tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:45:08.159036 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-f109ced4-8c84-4b76-a78b-909842a759fa tempest-VolumesTestJSON-458040589 tempest-VolumesTestJSON-458040589-project] 10.222.0.30 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.217312 Dec 24 10:45:08.159613 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 11/21] 10.222.0.30 () {58 vars in 1148 bytes} [Fri Dec 24 10:45:07 2021] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 10:45:08.173196 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-86b5e8cc-995b-4737-a5fe-6369d37fc365 tempest-VolumesTestJSON-458040589 tempest-VolumesTestJSON-458040589-project] Calling method '.version_select at 0x7f189a728160>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:45:08.197272 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-1b6ae1f3-fdfc-4a2f-b240-e00a6558dc1d tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75a06733f5d4b7e8044fe6a9914a5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52385c4779dd49e7b3f0d9e56a8d2d26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:45:08.206826 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-1b6ae1f3-fdfc-4a2f-b240-e00a6558dc1d tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] 10.222.0.30 "GET /compute/v2.1/servers/f77538c5-1e85-4d4f-b6cb-1c003149fac1" status: 200 len: 1211 microversion: 2.1 time: 0.298130 Dec 24 10:45:08.210560 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 11/22] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:45:07 2021] GET /compute/v2.1/servers/f77538c5-1e85-4d4f-b6cb-1c003149fac1 => generated 1211 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:45:08.321633 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-86b5e8cc-995b-4737-a5fe-6369d37fc365 tempest-VolumesTestJSON-458040589 tempest-VolumesTestJSON-458040589-project] 10.222.0.30 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.152982 Dec 24 10:45:08.321770 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 12/23] 10.222.0.30 () {58 vars in 1133 bytes} [Fri Dec 24 10:45:08 2021] GET /compute/v2.1/os-volumes => generated 1035 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:45:08.333484 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-93f20a2f-ee09-4db0-9456-aaec3f04a75f tempest-VolumesTestJSON-458040589 tempest-VolumesTestJSON-458040589-project] Calling method '.version_select at 0x7f189a7e2550>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:45:08.665173 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-d699e29d-96ee-4aeb-818c-15b745a9d339 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:45:08.665803 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-d699e29d-96ee-4aeb-818c-15b745a9d339 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] [instance: b18ab8db-0c1f-4343-ae07-953fc820b211] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:45:08.679179 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-93f20a2f-ee09-4db0-9456-aaec3f04a75f tempest-VolumesTestJSON-458040589 tempest-VolumesTestJSON-458040589-project] 10.222.0.30 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.350051 Dec 24 10:45:08.679752 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 12/24] 10.222.0.30 () {58 vars in 1166 bytes} [Fri Dec 24 10:45:08 2021] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 10:45:08.693738 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-37360732-33db-47f9-87b8-2a04d474bc80 tempest-VolumesTestJSON-458040589 tempest-VolumesTestJSON-458040589-project] Calling method '.version_select at 0x7f189a70f550>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:45:08.697278 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-d699e29d-96ee-4aeb-818c-15b745a9d339 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:45:08.698037 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-d699e29d-96ee-4aeb-818c-15b745a9d339 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:45:08.699515 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-d699e29d-96ee-4aeb-818c-15b745a9d339 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:45:08.700162 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-d699e29d-96ee-4aeb-818c-15b745a9d339 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:45:08.847395 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-d699e29d-96ee-4aeb-818c-15b745a9d339 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ad5096717dc425c849dfe95ea55a6af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62d11172cdf4959a15ac1ffc5601aca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:45:08.857617 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-d699e29d-96ee-4aeb-818c-15b745a9d339 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] 10.222.0.30 "GET /compute/v2.1/servers/b18ab8db-0c1f-4343-ae07-953fc820b211" status: 200 len: 1269 microversion: 2.1 time: 0.197598 Dec 24 10:45:08.858965 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 13/25] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:45:08 2021] GET /compute/v2.1/servers/b18ab8db-0c1f-4343-ae07-953fc820b211 => generated 1269 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:45:08.879320 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-37360732-33db-47f9-87b8-2a04d474bc80 tempest-VolumesTestJSON-458040589 tempest-VolumesTestJSON-458040589-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.187762 Dec 24 10:45:08.879320 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 13/26] 10.222.0.30 () {58 vars in 1169 bytes} [Fri Dec 24 10:45:08 2021] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 24 10:45:08.890883 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-f2449b1a-5622-404a-9e77-6ae5d71d0bc7 tempest-VolumesTestJSON-458040589 tempest-VolumesTestJSON-458040589-project] Calling method '.version_select at 0x7f189a767160>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:45:09.065592 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-f2449b1a-5622-404a-9e77-6ae5d71d0bc7 tempest-VolumesTestJSON-458040589 tempest-VolumesTestJSON-458040589-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.178604 Dec 24 10:45:09.066916 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 14/27] 10.222.0.30 () {58 vars in 1154 bytes} [Fri Dec 24 10:45:08 2021] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:45:09.078525 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-3c6882ff-a101-4e40-8829-03ee5b7e49b4 tempest-VolumesTestJSON-458040589 tempest-VolumesTestJSON-458040589-project] Calling method '.version_select at 0x7f189a70fb80>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:45:09.223995 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-780fa583-2f86-4529-a4b8-ee2e4f4273c4 tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:45:09.226290 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-780fa583-2f86-4529-a4b8-ee2e4f4273c4 tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] [instance: f77538c5-1e85-4d4f-b6cb-1c003149fac1] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:45:09.238794 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-780fa583-2f86-4529-a4b8-ee2e4f4273c4 tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:45:09.239670 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-780fa583-2f86-4529-a4b8-ee2e4f4273c4 tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:45:09.241778 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-780fa583-2f86-4529-a4b8-ee2e4f4273c4 tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:45:09.242487 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-780fa583-2f86-4529-a4b8-ee2e4f4273c4 tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:45:09.294511 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-3c6882ff-a101-4e40-8829-03ee5b7e49b4 tempest-VolumesTestJSON-458040589 tempest-VolumesTestJSON-458040589-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.220194 Dec 24 10:45:09.295291 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 14/28] 10.222.0.30 () {58 vars in 1187 bytes} [Fri Dec 24 10:45:09 2021] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 10:45:09.309946 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-fe0c85cf-a91d-494a-ad90-7a3839b0665f tempest-VolumesTestJSON-458040589 tempest-VolumesTestJSON-458040589-project] Calling method '.version_select at 0x7f189a763d30>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:45:09.585973 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-fe0c85cf-a91d-494a-ad90-7a3839b0665f tempest-VolumesTestJSON-458040589 tempest-VolumesTestJSON-458040589-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.282257 Dec 24 10:45:09.595380 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 15/29] 10.222.0.30 () {58 vars in 1154 bytes} [Fri Dec 24 10:45:09 2021] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 24 10:45:09.614154 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-780fa583-2f86-4529-a4b8-ee2e4f4273c4 tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75a06733f5d4b7e8044fe6a9914a5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52385c4779dd49e7b3f0d9e56a8d2d26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:45:09.629334 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-780fa583-2f86-4529-a4b8-ee2e4f4273c4 tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] 10.222.0.30 "GET /compute/v2.1/servers/f77538c5-1e85-4d4f-b6cb-1c003149fac1" status: 200 len: 1211 microversion: 2.1 time: 0.407485 Dec 24 10:45:09.634220 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 15/30] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:45:09 2021] GET /compute/v2.1/servers/f77538c5-1e85-4d4f-b6cb-1c003149fac1 => generated 1211 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 24 10:45:09.895609 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-fd938b52-c6a7-47b9-bdc2-313e20f65b4f tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:45:09.896160 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-fd938b52-c6a7-47b9-bdc2-313e20f65b4f tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] [instance: b18ab8db-0c1f-4343-ae07-953fc820b211] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:45:09.933997 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-fd938b52-c6a7-47b9-bdc2-313e20f65b4f tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:45:09.935764 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-fd938b52-c6a7-47b9-bdc2-313e20f65b4f tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:45:09.936608 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-fd938b52-c6a7-47b9-bdc2-313e20f65b4f tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:45:09.937093 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-fd938b52-c6a7-47b9-bdc2-313e20f65b4f tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:45:10.094058 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-fd938b52-c6a7-47b9-bdc2-313e20f65b4f tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ad5096717dc425c849dfe95ea55a6af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62d11172cdf4959a15ac1ffc5601aca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:45:10.116736 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-fd938b52-c6a7-47b9-bdc2-313e20f65b4f tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] 10.222.0.30 "GET /compute/v2.1/servers/b18ab8db-0c1f-4343-ae07-953fc820b211" status: 200 len: 1269 microversion: 2.1 time: 0.230893 Dec 24 10:45:10.118267 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 16/31] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:45:09 2021] GET /compute/v2.1/servers/b18ab8db-0c1f-4343-ae07-953fc820b211 => generated 1269 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:45:10.430645 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-6123a74e-e0e0-42d6-b591-123b6237dbb8 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1873596842", "imageRef": "fae8172d-77c4-4f40-905a-7285c185448c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "eb9a5afc-6224-46fc-bd18-c62e65532682"}]}} {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:45:10.519959 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.network.neutron [None req-6123a74e-e0e0-42d6-b591-123b6237dbb8 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] validate_networks() for [('eb9a5afc-6224-46fc-bd18-c62e65532682', None, None, None, None, None)] {{(pid=123432) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 24 10:45:10.545926 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-8bdec051-595a-4cf2-b714-d88bcc590427 tempest-VolumesNegativeTest-1067864000 tempest-VolumesNegativeTest-1067864000-project] Action: 'create', calling method: .version_select at 0x7f189b8be160>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-778527305", "metadata": {"Type": "work"}}} {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:45:10.549155 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-8bdec051-595a-4cf2-b714-d88bcc590427 tempest-VolumesNegativeTest-1067864000 tempest-VolumesNegativeTest-1067864000-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=123431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 24 10:45:10.550175 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-8bdec051-595a-4cf2-b714-d88bcc590427 tempest-VolumesNegativeTest-1067864000 tempest-VolumesNegativeTest-1067864000-project] 10.222.0.30 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.302202 Dec 24 10:45:10.550726 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 17/32] 10.222.0.30 () {60 vars in 1155 bytes} [Fri Dec 24 10:45:10 2021] POST /compute/v2.1/os-volumes => generated 127 bytes in 303 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Dec 24 10:45:10.626989 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-0960da7a-0aae-4d0e-95eb-aacb8bfb7026 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Action: 'create', calling method: .version_select at 0x7f189a6b33a0>, body: {"keypair": {"name": "tempest-keypair-1815752854"}} {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:45:10.655152 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.quota [None req-0960da7a-0aae-4d0e-95eb-aacb8bfb7026 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Getting quotas for project 8b52b70f10024974af39a32f1a1a2502. Resources: {'key_pairs'} {{(pid=123431) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 24 10:45:10.659503 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.quota [None req-0960da7a-0aae-4d0e-95eb-aacb8bfb7026 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Getting quotas for user e695a7efa1c1465b99a8fb0b434a59f2 and project 8b52b70f10024974af39a32f1a1a2502. Resources: {'key_pairs'} {{(pid=123431) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 24 10:45:10.892557 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.quota [None req-0960da7a-0aae-4d0e-95eb-aacb8bfb7026 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Getting quotas for project 8b52b70f10024974af39a32f1a1a2502. Resources: {'key_pairs'} {{(pid=123431) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 24 10:45:10.898412 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.quota [None req-0960da7a-0aae-4d0e-95eb-aacb8bfb7026 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Getting quotas for user e695a7efa1c1465b99a8fb0b434a59f2 and project 8b52b70f10024974af39a32f1a1a2502. Resources: {'key_pairs'} {{(pid=123431) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 24 10:45:10.918115 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-0960da7a-0aae-4d0e-95eb-aacb8bfb7026 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 201 len: 2316 microversion: 2.20 time: 0.365489 Dec 24 10:45:10.919190 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 18/33] 10.222.0.30 () {62 vars in 1198 bytes} [Fri Dec 24 10:45:10 2021] POST /compute/v2.1/os-keypairs => generated 2316 bytes in 368 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Dec 24 10:45:10.932259 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-193906c6-2eee-4a8c-8f53-97d2d6cc32ae tempest-VolumesNegativeTest-1067864000 tempest-VolumesNegativeTest-1067864000-project] Action: 'create', calling method: .version_select at 0x7f189a70f8b0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1663327939", "metadata": {"Type": "work"}}} {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:45:10.934295 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-193906c6-2eee-4a8c-8f53-97d2d6cc32ae tempest-VolumesNegativeTest-1067864000 tempest-VolumesNegativeTest-1067864000-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=123431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 24 10:45:10.935679 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-193906c6-2eee-4a8c-8f53-97d2d6cc32ae tempest-VolumesNegativeTest-1067864000 tempest-VolumesNegativeTest-1067864000-project] 10.222.0.30 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.009135 Dec 24 10:45:10.943384 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 19/34] 10.222.0.30 () {60 vars in 1155 bytes} [Fri Dec 24 10:45:10 2021] POST /compute/v2.1/os-volumes => generated 125 bytes in 18 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Dec 24 10:45:10.956957 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-aa097523-37fc-4a78-9f4b-0358ced6e1e0 tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:45:10.957872 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-aa097523-37fc-4a78-9f4b-0358ced6e1e0 tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] [instance: f77538c5-1e85-4d4f-b6cb-1c003149fac1] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:45:10.967002 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-aa097523-37fc-4a78-9f4b-0358ced6e1e0 tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:45:10.967605 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-aa097523-37fc-4a78-9f4b-0358ced6e1e0 tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:45:10.968749 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-aa097523-37fc-4a78-9f4b-0358ced6e1e0 tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:45:10.969341 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-aa097523-37fc-4a78-9f4b-0358ced6e1e0 tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:45:11.011897 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.virt.hardware [None req-6123a74e-e0e0-42d6-b591-123b6237dbb8 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Flavor limits 0:0:0 {{(pid=123432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 24 10:45:11.012371 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.virt.hardware [None req-6123a74e-e0e0-42d6-b591-123b6237dbb8 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Image limits 0:0:0 {{(pid=123432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 24 10:45:11.013086 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.virt.hardware [None req-6123a74e-e0e0-42d6-b591-123b6237dbb8 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Flavor pref 0:0:0 {{(pid=123432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 24 10:45:11.013711 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.virt.hardware [None req-6123a74e-e0e0-42d6-b591-123b6237dbb8 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Image pref 0:0:0 {{(pid=123432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 24 10:45:11.014272 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.virt.hardware [None req-6123a74e-e0e0-42d6-b591-123b6237dbb8 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 24 10:45:11.029723 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-6123a74e-e0e0-42d6-b591-123b6237dbb8 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:45:11.030216 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-6123a74e-e0e0-42d6-b591-123b6237dbb8 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:45:11.031526 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-6123a74e-e0e0-42d6-b591-123b6237dbb8 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:45:11.032058 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-6123a74e-e0e0-42d6-b591-123b6237dbb8 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:45:11.057519 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.quota [None req-6123a74e-e0e0-42d6-b591-123b6237dbb8 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Getting quotas for project 378bb44ad89440e49f7e290a5d31004e. Resources: {'instances', 'cores', 'ram'} {{(pid=123432) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 24 10:45:11.063819 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.quota [None req-6123a74e-e0e0-42d6-b591-123b6237dbb8 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Getting quotas for user 91d627b760f74f48ac560e2ce2e74e2a and project 378bb44ad89440e49f7e290a5d31004e. Resources: {'instances', 'cores', 'ram'} {{(pid=123432) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 24 10:45:11.089074 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-6123a74e-e0e0-42d6-b591-123b6237dbb8 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Going to run 1 instances... {{(pid=123432) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 24 10:45:11.089454 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-6123a74e-e0e0-42d6-b591-123b6237dbb8 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] [instance: 54d2f913-8385-4f34-8cb0-8c0f08c7a30f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fae8172d-77c4-4f40-905a-7285c185448c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123432) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 24 10:45:11.093841 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-aa097523-37fc-4a78-9f4b-0358ced6e1e0 tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75a06733f5d4b7e8044fe6a9914a5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52385c4779dd49e7b3f0d9e56a8d2d26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:45:11.102432 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-aa097523-37fc-4a78-9f4b-0358ced6e1e0 tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] 10.222.0.30 "GET /compute/v2.1/servers/f77538c5-1e85-4d4f-b6cb-1c003149fac1" status: 200 len: 1267 microversion: 2.1 time: 0.156667 Dec 24 10:45:11.116330 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 20/35] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:45:10 2021] GET /compute/v2.1/servers/f77538c5-1e85-4d4f-b6cb-1c003149fac1 => generated 1267 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:45:11.123320 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-331f9d67-107a-4a67-b192-ffe5cdbc3bd1 tempest-VolumesNegativeTest-1067864000 tempest-VolumesNegativeTest-1067864000-project] Action: 'create', calling method: .version_select at 0x7f189a6deca0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1992346830", "metadata": {"Type": "work"}}} {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:45:11.124901 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-331f9d67-107a-4a67-b192-ffe5cdbc3bd1 tempest-VolumesNegativeTest-1067864000 tempest-VolumesNegativeTest-1067864000-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=123431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 24 10:45:11.125853 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-331f9d67-107a-4a67-b192-ffe5cdbc3bd1 tempest-VolumesNegativeTest-1067864000 tempest-VolumesNegativeTest-1067864000-project] 10.222.0.30 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.008148 Dec 24 10:45:11.126482 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 21/36] 10.222.0.30 () {60 vars in 1155 bytes} [Fri Dec 24 10:45:11 2021] POST /compute/v2.1/os-volumes => generated 121 bytes in 9 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Dec 24 10:45:11.135757 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-47193a93-f052-4908-a4a5-4faf76a99897 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:45:11.136538 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-47193a93-f052-4908-a4a5-4faf76a99897 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] [instance: b18ab8db-0c1f-4343-ae07-953fc820b211] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:45:11.144087 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-47193a93-f052-4908-a4a5-4faf76a99897 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:45:11.151322 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-47193a93-f052-4908-a4a5-4faf76a99897 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:45:11.151322 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-47193a93-f052-4908-a4a5-4faf76a99897 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:45:11.151322 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-47193a93-f052-4908-a4a5-4faf76a99897 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:45:11.241258 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-6123a74e-e0e0-42d6-b591-123b6237dbb8 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.038690 Dec 24 10:45:11.242634 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 16/37] 10.222.0.30 () {60 vars in 1146 bytes} [Fri Dec 24 10:45:10 2021] POST /compute/v2.1/servers => generated 383 bytes in 1041 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 24 10:45:11.256767 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-fcc7fb2c-e55d-432d-8836-d8bd745d23eb tempest-VolumesNegativeTest-1067864000 tempest-VolumesNegativeTest-1067864000-project] Calling method '.version_select at 0x7f189a728dc0>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:45:11.345208 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.wsgi [None req-fcc7fb2c-e55d-432d-8836-d8bd745d23eb tempest-VolumesNegativeTest-1067864000 tempest-VolumesNegativeTest-1067864000-project] HTTP exception thrown: Volume tempest-invalid-858915098 could not be found. Dec 24 10:45:11.346680 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-fcc7fb2c-e55d-432d-8836-d8bd745d23eb tempest-VolumesNegativeTest-1067864000 tempest-VolumesNegativeTest-1067864000-project] Returning 404 to user: Volume tempest-invalid-858915098 could not be found. {{(pid=123432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 24 10:45:11.353493 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-fcc7fb2c-e55d-432d-8836-d8bd745d23eb tempest-VolumesNegativeTest-1067864000 tempest-VolumesNegativeTest-1067864000-project] 10.222.0.30 "DELETE /compute/v2.1/os-volumes/tempest-invalid-858915098" status: 404 len: 98 microversion: 2.1 time: 0.099340 Dec 24 10:45:11.353493 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 17/38] 10.222.0.30 () {58 vars in 1214 bytes} [Fri Dec 24 10:45:11 2021] DELETE /compute/v2.1/os-volumes/tempest-invalid-858915098 => generated 98 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Dec 24 10:45:11.375259 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-a1243c1a-f480-40e3-9aa0-697effdbdfce tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:45:11.376690 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-a1243c1a-f480-40e3-9aa0-697effdbdfce tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] [instance: 54d2f913-8385-4f34-8cb0-8c0f08c7a30f] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:45:11.508055 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-a1243c1a-f480-40e3-9aa0-697effdbdfce tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d627b760f74f48ac560e2ce2e74e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '378bb44ad89440e49f7e290a5d31004e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:45:11.554143 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-47193a93-f052-4908-a4a5-4faf76a99897 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ad5096717dc425c849dfe95ea55a6af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62d11172cdf4959a15ac1ffc5601aca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:45:11.559418 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-a1243c1a-f480-40e3-9aa0-697effdbdfce tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] 10.222.0.30 "GET /compute/v2.1/servers/54d2f913-8385-4f34-8cb0-8c0f08c7a30f" status: 200 len: 1222 microversion: 2.1 time: 0.206633 Dec 24 10:45:11.573903 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 18/39] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:45:11 2021] GET /compute/v2.1/servers/54d2f913-8385-4f34-8cb0-8c0f08c7a30f => generated 1222 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:45:11.578885 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-47193a93-f052-4908-a4a5-4faf76a99897 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] 10.222.0.30 "GET /compute/v2.1/servers/b18ab8db-0c1f-4343-ae07-953fc820b211" status: 200 len: 1277 microversion: 2.1 time: 0.446940 Dec 24 10:45:11.579640 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 22/40] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:45:11 2021] GET /compute/v2.1/servers/b18ab8db-0c1f-4343-ae07-953fc820b211 => generated 1277 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 24 10:45:11.601878 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-a77c5881-5ae2-4eea-9176-fcc555e1a707 tempest-VolumesNegativeTest-1067864000 tempest-VolumesNegativeTest-1067864000-project] 10.222.0.30 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.025280 Dec 24 10:45:11.609329 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 19/41] 10.222.0.30 () {58 vars in 1139 bytes} [Fri Dec 24 10:45:11 2021] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Dec 24 10:45:11.622814 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-2b81b5ca-84b5-4545-9334-bce27c23440e tempest-VolumesNegativeTest-1067864000 tempest-VolumesNegativeTest-1067864000-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.011903 Dec 24 10:45:11.628971 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 23/42] 10.222.0.30 () {58 vars in 1136 bytes} [Fri Dec 24 10:45:11 2021] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 13 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Dec 24 10:45:11.641804 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-30f6fb0e-46ae-4dd6-8a1d-8cb33c7c9ea6 tempest-VolumesNegativeTest-1067864000 tempest-VolumesNegativeTest-1067864000-project] Calling method '.version_select at 0x7f189a721670>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:45:11.763105 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.wsgi [None req-30f6fb0e-46ae-4dd6-8a1d-8cb33c7c9ea6 tempest-VolumesNegativeTest-1067864000 tempest-VolumesNegativeTest-1067864000-project] HTTP exception thrown: Volume 0fb24023-06f8-4acd-8427-efcdaf9a2ffa could not be found. Dec 24 10:45:11.763719 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-30f6fb0e-46ae-4dd6-8a1d-8cb33c7c9ea6 tempest-VolumesNegativeTest-1067864000 tempest-VolumesNegativeTest-1067864000-project] Returning 404 to user: Volume 0fb24023-06f8-4acd-8427-efcdaf9a2ffa could not be found. {{(pid=123432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 24 10:45:11.764569 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-30f6fb0e-46ae-4dd6-8a1d-8cb33c7c9ea6 tempest-VolumesNegativeTest-1067864000 tempest-VolumesNegativeTest-1067864000-project] 10.222.0.30 "DELETE /compute/v2.1/os-volumes/0fb24023-06f8-4acd-8427-efcdaf9a2ffa" status: 404 len: 109 microversion: 2.1 time: 0.132648 Dec 24 10:45:11.765195 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 20/43] 10.222.0.30 () {58 vars in 1247 bytes} [Fri Dec 24 10:45:11 2021] DELETE /compute/v2.1/os-volumes/0fb24023-06f8-4acd-8427-efcdaf9a2ffa => generated 109 bytes in 135 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 24 10:45:11.778605 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-f949909d-c0ac-46a8-8411-c40d79d6185c tempest-VolumesNegativeTest-1067864000 tempest-VolumesNegativeTest-1067864000-project] Calling method '.version_select at 0x7f189a6de310>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:45:11.837214 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-7bbf1326-655a-48bc-af9d-c7c209130aac tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1254495164", "imageRef": "fae8172d-77c4-4f40-905a-7285c185448c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "eb9a5afc-6224-46fc-bd18-c62e65532682"}]}} {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:45:11.876329 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.wsgi [None req-f949909d-c0ac-46a8-8411-c40d79d6185c tempest-VolumesNegativeTest-1067864000 tempest-VolumesNegativeTest-1067864000-project] HTTP exception thrown: Volume cfd23d22-ef97-4d89-9196-8cbe9f104ec9 could not be found. Dec 24 10:45:11.876964 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-f949909d-c0ac-46a8-8411-c40d79d6185c tempest-VolumesNegativeTest-1067864000 tempest-VolumesNegativeTest-1067864000-project] Returning 404 to user: Volume cfd23d22-ef97-4d89-9196-8cbe9f104ec9 could not be found. {{(pid=123431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 24 10:45:11.877802 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-f949909d-c0ac-46a8-8411-c40d79d6185c tempest-VolumesNegativeTest-1067864000 tempest-VolumesNegativeTest-1067864000-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/cfd23d22-ef97-4d89-9196-8cbe9f104ec9" status: 404 len: 109 microversion: 2.1 time: 0.103254 Dec 24 10:45:11.878610 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 24/44] 10.222.0.30 () {58 vars in 1244 bytes} [Fri Dec 24 10:45:11 2021] GET /compute/v2.1/os-volumes/cfd23d22-ef97-4d89-9196-8cbe9f104ec9 => generated 109 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 24 10:45:11.974474 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.network.neutron [None req-7bbf1326-655a-48bc-af9d-c7c209130aac tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] validate_networks() for [('eb9a5afc-6224-46fc-bd18-c62e65532682', None, None, None, None, None)] {{(pid=123432) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 24 10:45:12.122460 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-dcfc9e9c-3a4a-4af2-8bbe-05b320898ef1 tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:45:12.123863 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-dcfc9e9c-3a4a-4af2-8bbe-05b320898ef1 tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] [instance: f77538c5-1e85-4d4f-b6cb-1c003149fac1] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:45:12.155972 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-dcfc9e9c-3a4a-4af2-8bbe-05b320898ef1 tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:45:12.165628 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-dcfc9e9c-3a4a-4af2-8bbe-05b320898ef1 tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:45:12.175442 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-dcfc9e9c-3a4a-4af2-8bbe-05b320898ef1 tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:45:12.180537 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-dcfc9e9c-3a4a-4af2-8bbe-05b320898ef1 tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:45:12.386817 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-dcfc9e9c-3a4a-4af2-8bbe-05b320898ef1 tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75a06733f5d4b7e8044fe6a9914a5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52385c4779dd49e7b3f0d9e56a8d2d26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:45:12.396133 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-dcfc9e9c-3a4a-4af2-8bbe-05b320898ef1 tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] 10.222.0.30 "GET /compute/v2.1/servers/f77538c5-1e85-4d4f-b6cb-1c003149fac1" status: 200 len: 1273 microversion: 2.1 time: 0.280776 Dec 24 10:45:12.409006 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 25/45] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:45:12 2021] GET /compute/v2.1/servers/f77538c5-1e85-4d4f-b6cb-1c003149fac1 => generated 1273 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:45:12.599065 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-fd9f95cb-5ab7-423d-9ed7-406c472e36ca tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:45:12.600451 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-fd9f95cb-5ab7-423d-9ed7-406c472e36ca tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] [instance: b18ab8db-0c1f-4343-ae07-953fc820b211] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:45:12.613642 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-fd9f95cb-5ab7-423d-9ed7-406c472e36ca tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:45:12.614451 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-fd9f95cb-5ab7-423d-9ed7-406c472e36ca tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:45:12.617846 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-fd9f95cb-5ab7-423d-9ed7-406c472e36ca tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:45:12.618531 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-fd9f95cb-5ab7-423d-9ed7-406c472e36ca tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:45:12.794198 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-fd9f95cb-5ab7-423d-9ed7-406c472e36ca tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ad5096717dc425c849dfe95ea55a6af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62d11172cdf4959a15ac1ffc5601aca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:45:12.801877 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-fd9f95cb-5ab7-423d-9ed7-406c472e36ca tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] 10.222.0.30 "GET /compute/v2.1/servers/b18ab8db-0c1f-4343-ae07-953fc820b211" status: 200 len: 1275 microversion: 2.1 time: 0.206512 Dec 24 10:45:12.805835 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 26/46] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:45:12 2021] GET /compute/v2.1/servers/b18ab8db-0c1f-4343-ae07-953fc820b211 => generated 1275 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 24 10:45:13.419300 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-11b4a4f4-e750-44d7-8b40-1b89b5542d16 tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:45:13.420493 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-11b4a4f4-e750-44d7-8b40-1b89b5542d16 tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] [instance: f77538c5-1e85-4d4f-b6cb-1c003149fac1] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:45:13.431959 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-11b4a4f4-e750-44d7-8b40-1b89b5542d16 tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:45:13.434111 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-11b4a4f4-e750-44d7-8b40-1b89b5542d16 tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:45:13.437403 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-11b4a4f4-e750-44d7-8b40-1b89b5542d16 tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:45:13.439108 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-11b4a4f4-e750-44d7-8b40-1b89b5542d16 tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:45:13.598963 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-11b4a4f4-e750-44d7-8b40-1b89b5542d16 tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75a06733f5d4b7e8044fe6a9914a5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52385c4779dd49e7b3f0d9e56a8d2d26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:45:13.615342 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-11b4a4f4-e750-44d7-8b40-1b89b5542d16 tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] 10.222.0.30 "GET /compute/v2.1/servers/f77538c5-1e85-4d4f-b6cb-1c003149fac1" status: 200 len: 1273 microversion: 2.1 time: 0.196609 Dec 24 10:45:13.626104 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 27/47] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:45:13 2021] GET /compute/v2.1/servers/f77538c5-1e85-4d4f-b6cb-1c003149fac1 => generated 1273 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:45:13.822368 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-ee43479d-098f-4a13-9dab-982f80f5973b tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:45:13.822912 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-ee43479d-098f-4a13-9dab-982f80f5973b tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] [instance: b18ab8db-0c1f-4343-ae07-953fc820b211] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:45:13.834978 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-ee43479d-098f-4a13-9dab-982f80f5973b tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:45:13.835449 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-ee43479d-098f-4a13-9dab-982f80f5973b tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:45:13.848985 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-ee43479d-098f-4a13-9dab-982f80f5973b tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:45:13.850381 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-ee43479d-098f-4a13-9dab-982f80f5973b tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:45:14.316318 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.virt.hardware [None req-7bbf1326-655a-48bc-af9d-c7c209130aac tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Flavor limits 0:0:0 {{(pid=123432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 24 10:45:14.317031 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.virt.hardware [None req-7bbf1326-655a-48bc-af9d-c7c209130aac tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Image limits 0:0:0 {{(pid=123432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 24 10:45:14.317880 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.virt.hardware [None req-7bbf1326-655a-48bc-af9d-c7c209130aac tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Flavor pref 0:0:0 {{(pid=123432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 24 10:45:14.318798 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.virt.hardware [None req-7bbf1326-655a-48bc-af9d-c7c209130aac tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Image pref 0:0:0 {{(pid=123432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 24 10:45:14.319487 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.virt.hardware [None req-7bbf1326-655a-48bc-af9d-c7c209130aac tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 24 10:45:14.338806 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-7bbf1326-655a-48bc-af9d-c7c209130aac tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:45:14.345565 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-7bbf1326-655a-48bc-af9d-c7c209130aac tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:45:14.350907 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-7bbf1326-655a-48bc-af9d-c7c209130aac tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:45:14.354225 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-7bbf1326-655a-48bc-af9d-c7c209130aac tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:45:14.409722 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.quota [None req-7bbf1326-655a-48bc-af9d-c7c209130aac tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Getting quotas for project 378bb44ad89440e49f7e290a5d31004e. Resources: {'instances', 'cores', 'ram'} {{(pid=123432) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 24 10:45:14.419332 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.quota [None req-7bbf1326-655a-48bc-af9d-c7c209130aac tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Getting quotas for user 91d627b760f74f48ac560e2ce2e74e2a and project 378bb44ad89440e49f7e290a5d31004e. Resources: {'instances', 'cores', 'ram'} {{(pid=123432) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 24 10:45:14.454510 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-7bbf1326-655a-48bc-af9d-c7c209130aac tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Going to run 1 instances... {{(pid=123432) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 24 10:45:14.457428 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-7bbf1326-655a-48bc-af9d-c7c209130aac tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] [instance: c2c661f2-d3da-4357-a7a8-3f85fc94cc60] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fae8172d-77c4-4f40-905a-7285c185448c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123432) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 24 10:45:14.666575 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-7bbf1326-655a-48bc-af9d-c7c209130aac tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.833990 Dec 24 10:45:14.667597 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 21/48] 10.222.0.30 () {60 vars in 1146 bytes} [Fri Dec 24 10:45:11 2021] POST /compute/v2.1/servers => generated 383 bytes in 2836 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 24 10:45:14.687755 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-1cf6cad9-e345-4c9f-b968-5ff52b3cd39c tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:45:14.692448 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-1cf6cad9-e345-4c9f-b968-5ff52b3cd39c tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] [instance: f77538c5-1e85-4d4f-b6cb-1c003149fac1] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:45:14.734697 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-1cf6cad9-e345-4c9f-b968-5ff52b3cd39c tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:45:14.741761 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-1cf6cad9-e345-4c9f-b968-5ff52b3cd39c tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:45:14.741761 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-1cf6cad9-e345-4c9f-b968-5ff52b3cd39c tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:45:14.741761 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-1cf6cad9-e345-4c9f-b968-5ff52b3cd39c tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:45:14.781347 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-ee43479d-098f-4a13-9dab-982f80f5973b tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ad5096717dc425c849dfe95ea55a6af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62d11172cdf4959a15ac1ffc5601aca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:45:14.805724 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-ee43479d-098f-4a13-9dab-982f80f5973b tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] 10.222.0.30 "GET /compute/v2.1/servers/b18ab8db-0c1f-4343-ae07-953fc820b211" status: 200 len: 1317 microversion: 2.1 time: 0.985814 Dec 24 10:45:14.811141 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 28/49] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:45:13 2021] GET /compute/v2.1/servers/b18ab8db-0c1f-4343-ae07-953fc820b211 => generated 1317 bytes in 994 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 24 10:45:14.822676 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-bd48466a-38dc-41db-aa77-e65586d48808 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:45:14.823295 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-bd48466a-38dc-41db-aa77-e65586d48808 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] [instance: c2c661f2-d3da-4357-a7a8-3f85fc94cc60] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:45:15.236604 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-bd48466a-38dc-41db-aa77-e65586d48808 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d627b760f74f48ac560e2ce2e74e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '378bb44ad89440e49f7e290a5d31004e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:45:15.255058 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-bd48466a-38dc-41db-aa77-e65586d48808 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] 10.222.0.30 "GET /compute/v2.1/servers/c2c661f2-d3da-4357-a7a8-3f85fc94cc60" status: 200 len: 1222 microversion: 2.1 time: 0.431709 Dec 24 10:45:15.255058 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 29/50] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:45:14 2021] GET /compute/v2.1/servers/c2c661f2-d3da-4357-a7a8-3f85fc94cc60 => generated 1222 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:45:15.737938 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-1cf6cad9-e345-4c9f-b968-5ff52b3cd39c tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75a06733f5d4b7e8044fe6a9914a5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52385c4779dd49e7b3f0d9e56a8d2d26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:45:15.760313 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-1cf6cad9-e345-4c9f-b968-5ff52b3cd39c tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] 10.222.0.30 "GET /compute/v2.1/servers/f77538c5-1e85-4d4f-b6cb-1c003149fac1" status: 200 len: 1315 microversion: 2.1 time: 1.088257 Dec 24 10:45:15.761438 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 22/51] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:45:14 2021] GET /compute/v2.1/servers/f77538c5-1e85-4d4f-b6cb-1c003149fac1 => generated 1315 bytes in 1092 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:45:15.826778 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-637eb8f5-4b37-4ec3-9d1e-d6cb3e3c7b74 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:45:15.827400 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-637eb8f5-4b37-4ec3-9d1e-d6cb3e3c7b74 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] [instance: b18ab8db-0c1f-4343-ae07-953fc820b211] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:45:15.855635 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-637eb8f5-4b37-4ec3-9d1e-d6cb3e3c7b74 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:45:15.855635 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-637eb8f5-4b37-4ec3-9d1e-d6cb3e3c7b74 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:45:15.856455 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-637eb8f5-4b37-4ec3-9d1e-d6cb3e3c7b74 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:45:15.856980 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-637eb8f5-4b37-4ec3-9d1e-d6cb3e3c7b74 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:45:16.269983 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-19381e0e-8437-460f-97f4-8e1b98f434ae tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:45:16.270968 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-19381e0e-8437-460f-97f4-8e1b98f434ae tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] [instance: c2c661f2-d3da-4357-a7a8-3f85fc94cc60] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:45:16.463197 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-19381e0e-8437-460f-97f4-8e1b98f434ae tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d627b760f74f48ac560e2ce2e74e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '378bb44ad89440e49f7e290a5d31004e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:45:16.473837 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-19381e0e-8437-460f-97f4-8e1b98f434ae tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] 10.222.0.30 "GET /compute/v2.1/servers/c2c661f2-d3da-4357-a7a8-3f85fc94cc60" status: 200 len: 1222 microversion: 2.1 time: 0.214488 Dec 24 10:45:16.479363 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 23/52] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:45:16 2021] GET /compute/v2.1/servers/c2c661f2-d3da-4357-a7a8-3f85fc94cc60 => generated 1222 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:45:16.778933 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-c7c6f1a2-5b77-460a-8aac-df157d33c1e6 tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:45:16.780265 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-c7c6f1a2-5b77-460a-8aac-df157d33c1e6 tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] [instance: f77538c5-1e85-4d4f-b6cb-1c003149fac1] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:45:16.794381 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-c7c6f1a2-5b77-460a-8aac-df157d33c1e6 tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:45:16.795776 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-c7c6f1a2-5b77-460a-8aac-df157d33c1e6 tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:45:16.797310 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-c7c6f1a2-5b77-460a-8aac-df157d33c1e6 tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:45:16.799067 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-c7c6f1a2-5b77-460a-8aac-df157d33c1e6 tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:45:17.790276 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-c7c6f1a2-5b77-460a-8aac-df157d33c1e6 tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75a06733f5d4b7e8044fe6a9914a5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52385c4779dd49e7b3f0d9e56a8d2d26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:45:17.792005 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-637eb8f5-4b37-4ec3-9d1e-d6cb3e3c7b74 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ad5096717dc425c849dfe95ea55a6af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62d11172cdf4959a15ac1ffc5601aca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:45:17.802461 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-c7c6f1a2-5b77-460a-8aac-df157d33c1e6 tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] 10.222.0.30 "GET /compute/v2.1/servers/f77538c5-1e85-4d4f-b6cb-1c003149fac1" status: 200 len: 1315 microversion: 2.1 time: 1.027543 Dec 24 10:45:17.804650 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 24/53] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:45:16 2021] GET /compute/v2.1/servers/f77538c5-1e85-4d4f-b6cb-1c003149fac1 => generated 1315 bytes in 1031 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:45:17.817514 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-53ed3adb-d739-4b1a-be62-66da66a54f35 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:45:17.827043 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-53ed3adb-d739-4b1a-be62-66da66a54f35 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] [instance: c2c661f2-d3da-4357-a7a8-3f85fc94cc60] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:45:17.840438 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-637eb8f5-4b37-4ec3-9d1e-d6cb3e3c7b74 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] 10.222.0.30 "GET /compute/v2.1/servers/b18ab8db-0c1f-4343-ae07-953fc820b211" status: 200 len: 1317 microversion: 2.1 time: 2.012087 Dec 24 10:45:17.851480 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 30/54] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:45:15 2021] GET /compute/v2.1/servers/b18ab8db-0c1f-4343-ae07-953fc820b211 => generated 1317 bytes in 2025 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:45:17.856546 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-53ed3adb-d739-4b1a-be62-66da66a54f35 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:45:17.858435 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-53ed3adb-d739-4b1a-be62-66da66a54f35 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:45:17.859370 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-53ed3adb-d739-4b1a-be62-66da66a54f35 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:45:17.864679 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-53ed3adb-d739-4b1a-be62-66da66a54f35 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:45:18.072611 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-53ed3adb-d739-4b1a-be62-66da66a54f35 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d627b760f74f48ac560e2ce2e74e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '378bb44ad89440e49f7e290a5d31004e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:45:18.082879 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-53ed3adb-d739-4b1a-be62-66da66a54f35 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] 10.222.0.30 "GET /compute/v2.1/servers/c2c661f2-d3da-4357-a7a8-3f85fc94cc60" status: 200 len: 1274 microversion: 2.1 time: 0.276296 Dec 24 10:45:18.085481 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 25/55] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:45:17 2021] GET /compute/v2.1/servers/c2c661f2-d3da-4357-a7a8-3f85fc94cc60 => generated 1274 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:45:18.820542 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-3cce89d1-97b7-4853-92da-5766359c251a tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:45:18.821763 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-3cce89d1-97b7-4853-92da-5766359c251a tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] [instance: f77538c5-1e85-4d4f-b6cb-1c003149fac1] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:45:18.834777 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-3cce89d1-97b7-4853-92da-5766359c251a tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:45:18.834777 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-3cce89d1-97b7-4853-92da-5766359c251a tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:45:18.834777 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-3cce89d1-97b7-4853-92da-5766359c251a tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:45:18.834777 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-3cce89d1-97b7-4853-92da-5766359c251a tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:45:18.858721 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-15f74747-233f-4c27-b62b-406b4684962f tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:45:18.859946 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-15f74747-233f-4c27-b62b-406b4684962f tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] [instance: b18ab8db-0c1f-4343-ae07-953fc820b211] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:45:18.868167 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-15f74747-233f-4c27-b62b-406b4684962f tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:45:18.878699 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-15f74747-233f-4c27-b62b-406b4684962f tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:45:18.880185 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-15f74747-233f-4c27-b62b-406b4684962f tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:45:18.880836 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-15f74747-233f-4c27-b62b-406b4684962f tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:45:19.978232 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-15f74747-233f-4c27-b62b-406b4684962f tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ad5096717dc425c849dfe95ea55a6af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62d11172cdf4959a15ac1ffc5601aca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:45:20.004425 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-15f74747-233f-4c27-b62b-406b4684962f tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] 10.222.0.30 "GET /compute/v2.1/servers/b18ab8db-0c1f-4343-ae07-953fc820b211" status: 200 len: 1317 microversion: 2.1 time: 1.149265 Dec 24 10:45:20.010660 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 26/56] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:45:18 2021] GET /compute/v2.1/servers/b18ab8db-0c1f-4343-ae07-953fc820b211 => generated 1317 bytes in 1156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:45:20.031471 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-c3cc96bd-7185-4598-8bdc-2131377f7f8b tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:45:20.032199 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-c3cc96bd-7185-4598-8bdc-2131377f7f8b tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] [instance: c2c661f2-d3da-4357-a7a8-3f85fc94cc60] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:45:20.047927 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-c3cc96bd-7185-4598-8bdc-2131377f7f8b tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:45:20.052682 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-c3cc96bd-7185-4598-8bdc-2131377f7f8b tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:45:20.059003 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-c3cc96bd-7185-4598-8bdc-2131377f7f8b tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:45:20.061215 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-c3cc96bd-7185-4598-8bdc-2131377f7f8b tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:45:20.375716 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-c3cc96bd-7185-4598-8bdc-2131377f7f8b tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d627b760f74f48ac560e2ce2e74e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '378bb44ad89440e49f7e290a5d31004e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:45:20.396872 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-c3cc96bd-7185-4598-8bdc-2131377f7f8b tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] 10.222.0.30 "GET /compute/v2.1/servers/c2c661f2-d3da-4357-a7a8-3f85fc94cc60" status: 200 len: 1280 microversion: 2.1 time: 0.381997 Dec 24 10:45:20.404439 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 27/57] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:45:20 2021] GET /compute/v2.1/servers/c2c661f2-d3da-4357-a7a8-3f85fc94cc60 => generated 1280 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:45:20.617650 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-3cce89d1-97b7-4853-92da-5766359c251a tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75a06733f5d4b7e8044fe6a9914a5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52385c4779dd49e7b3f0d9e56a8d2d26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:45:20.630487 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-3cce89d1-97b7-4853-92da-5766359c251a tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] 10.222.0.30 "GET /compute/v2.1/servers/f77538c5-1e85-4d4f-b6cb-1c003149fac1" status: 200 len: 1315 microversion: 2.1 time: 1.813371 Dec 24 10:45:20.631627 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 31/58] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:45:18 2021] GET /compute/v2.1/servers/f77538c5-1e85-4d4f-b6cb-1c003149fac1 => generated 1315 bytes in 1815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:45:20.721978 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [req-076075c5-d77a-4339-a54a-31edd14787ae req-60a06881-6fc6-4906-bd9c-97bed8dc57ba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f77538c5-1e85-4d4f-b6cb-1c003149fac1", "tag": "194d1221-8d93-48d8-9ae0-aff4aac7c1b9"}]} {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:45:20.725652 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 10:45:20.725652 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: warnings.warn(msg) Dec 24 10:45:20.743610 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [req-076075c5-d77a-4339-a54a-31edd14787ae req-60a06881-6fc6-4906-bd9c-97bed8dc57ba service nova] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:45:20.744435 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [req-076075c5-d77a-4339-a54a-31edd14787ae req-60a06881-6fc6-4906-bd9c-97bed8dc57ba service nova] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:45:20.806907 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.compute.server_external_events [req-076075c5-d77a-4339-a54a-31edd14787ae req-60a06881-6fc6-4906-bd9c-97bed8dc57ba service nova] Creating event network-changed:194d1221-8d93-48d8-9ae0-aff4aac7c1b9 for instance f77538c5-1e85-4d4f-b6cb-1c003149fac1 on hv-cinder-81644 Dec 24 10:45:20.822335 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [req-076075c5-d77a-4339-a54a-31edd14787ae req-60a06881-6fc6-4906-bd9c-97bed8dc57ba service nova] Acquired lock "compute-rpcapi-router" {{(pid=123432) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Dec 24 10:45:20.822335 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-f4c7a89e-683f-4c5f-ba24-98e37cc4d90e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:45:20.822335 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-f4c7a89e-683f-4c5f-ba24-98e37cc4d90e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:45:20.822335 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-f4c7a89e-683f-4c5f-ba24-98e37cc4d90e None None] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:45:20.822335 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-f4c7a89e-683f-4c5f-ba24-98e37cc4d90e None None] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:45:20.825185 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.compute.rpcapi [None req-f4c7a89e-683f-4c5f-ba24-98e37cc4d90e None None] Automatically selected compute RPC version 6.0 from minimum service version 60 Dec 24 10:45:20.827391 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-f4c7a89e-683f-4c5f-ba24-98e37cc4d90e None None] Releasing lock "compute-rpcapi-router" {{(pid=123432) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Dec 24 10:45:20.857862 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-f4c7a89e-683f-4c5f-ba24-98e37cc4d90e None None] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.331747 Dec 24 10:45:20.859257 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 28/59] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Dec 24 10:45:20 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 24 10:45:21.023520 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-d9d98cd0-c13d-4540-b8b2-69c0bf3ecc72 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:45:21.026637 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-d9d98cd0-c13d-4540-b8b2-69c0bf3ecc72 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] [instance: b18ab8db-0c1f-4343-ae07-953fc820b211] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:45:21.039618 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-d9d98cd0-c13d-4540-b8b2-69c0bf3ecc72 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:45:21.043700 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-d9d98cd0-c13d-4540-b8b2-69c0bf3ecc72 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:45:21.046997 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-d9d98cd0-c13d-4540-b8b2-69c0bf3ecc72 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:45:21.047774 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-d9d98cd0-c13d-4540-b8b2-69c0bf3ecc72 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:45:21.290290 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [req-dbaaa6c8-a621-4c1b-b8f5-d1ef4c7ec4e5 req-ea12c4b6-02b0-4c67-84e8-8f549f5405ac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b18ab8db-0c1f-4343-ae07-953fc820b211", "tag": "c73f6a9a-c9cb-49c0-9d7c-7793864fb03a"}]} {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:45:21.297693 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 10:45:21.297693 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: warnings.warn(msg) Dec 24 10:45:21.350654 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [req-dbaaa6c8-a621-4c1b-b8f5-d1ef4c7ec4e5 req-ea12c4b6-02b0-4c67-84e8-8f549f5405ac service nova] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:45:21.354272 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [req-dbaaa6c8-a621-4c1b-b8f5-d1ef4c7ec4e5 req-ea12c4b6-02b0-4c67-84e8-8f549f5405ac service nova] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:45:21.417679 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.compute.server_external_events [req-dbaaa6c8-a621-4c1b-b8f5-d1ef4c7ec4e5 req-ea12c4b6-02b0-4c67-84e8-8f549f5405ac service nova] Creating event network-changed:c73f6a9a-c9cb-49c0-9d7c-7793864fb03a for instance b18ab8db-0c1f-4343-ae07-953fc820b211 on hv-cinder-81644 Dec 24 10:45:21.418888 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [req-dbaaa6c8-a621-4c1b-b8f5-d1ef4c7ec4e5 req-ea12c4b6-02b0-4c67-84e8-8f549f5405ac service nova] Acquired lock "compute-rpcapi-router" {{(pid=123431) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Dec 24 10:45:21.422543 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-10e01883-5d4f-4480-8d26-2b3ae58c3d38 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:45:21.423484 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-10e01883-5d4f-4480-8d26-2b3ae58c3d38 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:45:21.425744 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-10e01883-5d4f-4480-8d26-2b3ae58c3d38 None None] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:45:21.426452 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-10e01883-5d4f-4480-8d26-2b3ae58c3d38 None None] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:45:21.439197 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.compute.rpcapi [None req-10e01883-5d4f-4480-8d26-2b3ae58c3d38 None None] Automatically selected compute RPC version 6.0 from minimum service version 60 Dec 24 10:45:21.440617 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-10e01883-5d4f-4480-8d26-2b3ae58c3d38 None None] Releasing lock "compute-rpcapi-router" {{(pid=123431) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Dec 24 10:45:21.517973 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-10e01883-5d4f-4480-8d26-2b3ae58c3d38 None None] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.507848 Dec 24 10:45:21.519256 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 32/60] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Dec 24 10:45:21 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 10:45:21.526153 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-f9903dc6-8a9f-43ab-91f9-2fd94e14d795 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:45:21.527158 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-f9903dc6-8a9f-43ab-91f9-2fd94e14d795 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] [instance: c2c661f2-d3da-4357-a7a8-3f85fc94cc60] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:45:21.557557 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-f9903dc6-8a9f-43ab-91f9-2fd94e14d795 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:45:21.559830 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-f9903dc6-8a9f-43ab-91f9-2fd94e14d795 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:45:21.561496 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-f9903dc6-8a9f-43ab-91f9-2fd94e14d795 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:45:21.570060 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-f9903dc6-8a9f-43ab-91f9-2fd94e14d795 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:45:21.625562 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-d9d98cd0-c13d-4540-b8b2-69c0bf3ecc72 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ad5096717dc425c849dfe95ea55a6af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62d11172cdf4959a15ac1ffc5601aca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:45:21.634884 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-d9d98cd0-c13d-4540-b8b2-69c0bf3ecc72 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] 10.222.0.30 "GET /compute/v2.1/servers/b18ab8db-0c1f-4343-ae07-953fc820b211" status: 200 len: 1317 microversion: 2.1 time: 0.616110 Dec 24 10:45:21.650684 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 29/61] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:45:21 2021] GET /compute/v2.1/servers/b18ab8db-0c1f-4343-ae07-953fc820b211 => generated 1317 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:45:21.655872 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-6ff592d4-bfda-4666-910d-337c12b54ff5 tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:45:21.663980 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-6ff592d4-bfda-4666-910d-337c12b54ff5 tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] [instance: f77538c5-1e85-4d4f-b6cb-1c003149fac1] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:45:21.679854 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-6ff592d4-bfda-4666-910d-337c12b54ff5 tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:45:21.680630 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-6ff592d4-bfda-4666-910d-337c12b54ff5 tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:45:21.681716 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-6ff592d4-bfda-4666-910d-337c12b54ff5 tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:45:21.684099 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-6ff592d4-bfda-4666-910d-337c12b54ff5 tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:45:22.140498 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-6ff592d4-bfda-4666-910d-337c12b54ff5 tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75a06733f5d4b7e8044fe6a9914a5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52385c4779dd49e7b3f0d9e56a8d2d26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:45:22.148526 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-6ff592d4-bfda-4666-910d-337c12b54ff5 tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] 10.222.0.30 "GET /compute/v2.1/servers/f77538c5-1e85-4d4f-b6cb-1c003149fac1" status: 200 len: 1315 microversion: 2.1 time: 0.496331 Dec 24 10:45:22.152147 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 30/62] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:45:21 2021] GET /compute/v2.1/servers/f77538c5-1e85-4d4f-b6cb-1c003149fac1 => generated 1315 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:45:22.165116 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-40364d41-0f52-43b7-b60e-9424e7310805 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1040860334", "imageRef": "fae8172d-77c4-4f40-905a-7285c185448c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c0b8ee9e-b93e-467f-bfaf-ed33e3a53f71"}], "security_groups": [{"name": "tempest-securitygroup--529079024"}], "key_name": "tempest-keypair-1815752854", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:45:22.360503 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.network.neutron [None req-40364d41-0f52-43b7-b60e-9424e7310805 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] validate_networks() for [('c0b8ee9e-b93e-467f-bfaf-ed33e3a53f71', None, None, None, None, None)] {{(pid=123432) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 24 10:45:22.397099 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-f9903dc6-8a9f-43ab-91f9-2fd94e14d795 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d627b760f74f48ac560e2ce2e74e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '378bb44ad89440e49f7e290a5d31004e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:45:22.405409 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-f9903dc6-8a9f-43ab-91f9-2fd94e14d795 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] 10.222.0.30 "GET /compute/v2.1/servers/c2c661f2-d3da-4357-a7a8-3f85fc94cc60" status: 200 len: 1280 microversion: 2.1 time: 0.884704 Dec 24 10:45:22.409027 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 33/63] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:45:21 2021] GET /compute/v2.1/servers/c2c661f2-d3da-4357-a7a8-3f85fc94cc60 => generated 1280 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:45:22.658866 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-4db64d55-8e9a-466b-8729-96edb59f79de tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:45:22.660011 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-4db64d55-8e9a-466b-8729-96edb59f79de tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] [instance: b18ab8db-0c1f-4343-ae07-953fc820b211] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:45:22.667356 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-4db64d55-8e9a-466b-8729-96edb59f79de tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:45:22.668145 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-4db64d55-8e9a-466b-8729-96edb59f79de tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:45:22.669772 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-4db64d55-8e9a-466b-8729-96edb59f79de tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:45:22.671072 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-4db64d55-8e9a-466b-8729-96edb59f79de tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:45:23.022904 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-4db64d55-8e9a-466b-8729-96edb59f79de tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ad5096717dc425c849dfe95ea55a6af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62d11172cdf4959a15ac1ffc5601aca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:45:23.045676 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-4db64d55-8e9a-466b-8729-96edb59f79de tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] 10.222.0.30 "GET /compute/v2.1/servers/b18ab8db-0c1f-4343-ae07-953fc820b211" status: 200 len: 1317 microversion: 2.1 time: 0.391718 Dec 24 10:45:23.049688 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 34/64] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:45:22 2021] GET /compute/v2.1/servers/b18ab8db-0c1f-4343-ae07-953fc820b211 => generated 1317 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 24 10:45:23.168676 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-d0c67975-91a8-4714-b11d-083832a4f626 tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:45:23.171487 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-d0c67975-91a8-4714-b11d-083832a4f626 tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] [instance: f77538c5-1e85-4d4f-b6cb-1c003149fac1] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:45:23.193491 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-d0c67975-91a8-4714-b11d-083832a4f626 tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:45:23.196439 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-d0c67975-91a8-4714-b11d-083832a4f626 tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:45:23.197988 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-d0c67975-91a8-4714-b11d-083832a4f626 tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:45:23.201149 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-d0c67975-91a8-4714-b11d-083832a4f626 tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:45:23.873474 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.virt.hardware [None req-40364d41-0f52-43b7-b60e-9424e7310805 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Flavor limits 0:0:0 {{(pid=123432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 24 10:45:23.873474 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.virt.hardware [None req-40364d41-0f52-43b7-b60e-9424e7310805 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Image limits 0:0:0 {{(pid=123432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 24 10:45:23.873474 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.virt.hardware [None req-40364d41-0f52-43b7-b60e-9424e7310805 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Flavor pref 0:0:0 {{(pid=123432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 24 10:45:23.873474 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.virt.hardware [None req-40364d41-0f52-43b7-b60e-9424e7310805 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Image pref 0:0:0 {{(pid=123432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 24 10:45:23.874543 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.virt.hardware [None req-40364d41-0f52-43b7-b60e-9424e7310805 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 24 10:45:23.886121 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-d0c67975-91a8-4714-b11d-083832a4f626 tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75a06733f5d4b7e8044fe6a9914a5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52385c4779dd49e7b3f0d9e56a8d2d26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:45:23.894923 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-d0c67975-91a8-4714-b11d-083832a4f626 tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] 10.222.0.30 "GET /compute/v2.1/servers/f77538c5-1e85-4d4f-b6cb-1c003149fac1" status: 200 len: 1315 microversion: 2.1 time: 0.730603 Dec 24 10:45:23.898570 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-40364d41-0f52-43b7-b60e-9424e7310805 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:45:23.899212 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 35/65] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:45:23 2021] GET /compute/v2.1/servers/f77538c5-1e85-4d4f-b6cb-1c003149fac1 => generated 1315 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:45:23.900930 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-40364d41-0f52-43b7-b60e-9424e7310805 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:45:23.902682 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-40364d41-0f52-43b7-b60e-9424e7310805 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:45:23.903267 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-40364d41-0f52-43b7-b60e-9424e7310805 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:45:23.924218 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-d2f54d6d-980b-4c2b-b2b1-76c53bb11bc3 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:45:23.924947 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-d2f54d6d-980b-4c2b-b2b1-76c53bb11bc3 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] [instance: c2c661f2-d3da-4357-a7a8-3f85fc94cc60] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:45:23.927157 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.quota [None req-40364d41-0f52-43b7-b60e-9424e7310805 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Getting quotas for project 8b52b70f10024974af39a32f1a1a2502. Resources: {'instances', 'cores', 'ram'} {{(pid=123432) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 24 10:45:23.934277 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.quota [None req-40364d41-0f52-43b7-b60e-9424e7310805 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Getting quotas for user e695a7efa1c1465b99a8fb0b434a59f2 and project 8b52b70f10024974af39a32f1a1a2502. Resources: {'instances', 'cores', 'ram'} {{(pid=123432) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 24 10:45:23.945169 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-d2f54d6d-980b-4c2b-b2b1-76c53bb11bc3 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:45:23.951642 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-d2f54d6d-980b-4c2b-b2b1-76c53bb11bc3 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:45:23.951642 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-d2f54d6d-980b-4c2b-b2b1-76c53bb11bc3 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:45:23.951642 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-d2f54d6d-980b-4c2b-b2b1-76c53bb11bc3 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:45:23.951939 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-40364d41-0f52-43b7-b60e-9424e7310805 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Going to run 1 instances... {{(pid=123432) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 24 10:45:23.951939 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-40364d41-0f52-43b7-b60e-9424e7310805 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] [instance: a99a6a98-4010-4f8e-a83f-fcc490f6ece0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fae8172d-77c4-4f40-905a-7285c185448c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123432) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 24 10:45:24.156752 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-40364d41-0f52-43b7-b60e-9424e7310805 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 2.003337 Dec 24 10:45:24.161533 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 31/66] 10.222.0.30 () {62 vars in 1187 bytes} [Fri Dec 24 10:45:22 2021] POST /compute/v2.1/servers => generated 401 bytes in 2009 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Dec 24 10:45:24.171396 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [req-cb98127d-0744-41a8-8b2e-704cd69ed24e req-2797d48a-c8e5-4059-82c3-0e19d9e5c85b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "54d2f913-8385-4f34-8cb0-8c0f08c7a30f", "tag": "44345f3a-e246-4a77-8d9d-bd7357043c0b"}]} {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:45:24.178086 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 10:45:24.178086 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: warnings.warn(msg) Dec 24 10:45:24.196192 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [req-cb98127d-0744-41a8-8b2e-704cd69ed24e req-2797d48a-c8e5-4059-82c3-0e19d9e5c85b service nova] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:45:24.198827 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [req-cb98127d-0744-41a8-8b2e-704cd69ed24e req-2797d48a-c8e5-4059-82c3-0e19d9e5c85b service nova] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:45:24.234655 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.compute.server_external_events [req-cb98127d-0744-41a8-8b2e-704cd69ed24e req-2797d48a-c8e5-4059-82c3-0e19d9e5c85b service nova] Creating event network-changed:44345f3a-e246-4a77-8d9d-bd7357043c0b for instance 54d2f913-8385-4f34-8cb0-8c0f08c7a30f on hv-cinder-81644 Dec 24 10:45:24.254732 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [req-cb98127d-0744-41a8-8b2e-704cd69ed24e req-2797d48a-c8e5-4059-82c3-0e19d9e5c85b service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091549 Dec 24 10:45:24.264727 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 32/67] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Dec 24 10:45:24 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 10:45:24.287023 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-8c7c4e6c-d531-45f4-a499-4b66113a4b45 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:45:24.291197 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-8c7c4e6c-d531-45f4-a499-4b66113a4b45 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] [instance: b18ab8db-0c1f-4343-ae07-953fc820b211] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:45:24.312237 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-8c7c4e6c-d531-45f4-a499-4b66113a4b45 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:45:24.312718 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-8c7c4e6c-d531-45f4-a499-4b66113a4b45 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:45:24.313554 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-8c7c4e6c-d531-45f4-a499-4b66113a4b45 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:45:24.314089 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-8c7c4e6c-d531-45f4-a499-4b66113a4b45 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:45:24.512122 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-d2f54d6d-980b-4c2b-b2b1-76c53bb11bc3 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d627b760f74f48ac560e2ce2e74e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '378bb44ad89440e49f7e290a5d31004e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:45:24.526292 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-d2f54d6d-980b-4c2b-b2b1-76c53bb11bc3 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] 10.222.0.30 "GET /compute/v2.1/servers/c2c661f2-d3da-4357-a7a8-3f85fc94cc60" status: 200 len: 1322 microversion: 2.1 time: 0.625248 Dec 24 10:45:24.530952 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 36/68] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:45:23 2021] GET /compute/v2.1/servers/c2c661f2-d3da-4357-a7a8-3f85fc94cc60 => generated 1322 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:45:24.547009 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-e2d4cf6a-94e8-48ab-88f0-0cb542ba4085 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:45:24.547962 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-e2d4cf6a-94e8-48ab-88f0-0cb542ba4085 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] [instance: a99a6a98-4010-4f8e-a83f-fcc490f6ece0] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:45:24.704747 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-e2d4cf6a-94e8-48ab-88f0-0cb542ba4085 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:45:24.736501 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-e2d4cf6a-94e8-48ab-88f0-0cb542ba4085 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:45:24.739470 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-e2d4cf6a-94e8-48ab-88f0-0cb542ba4085 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:45:24.742545 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-e2d4cf6a-94e8-48ab-88f0-0cb542ba4085 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] 10.222.0.30 "GET /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0" status: 200 len: 1282 microversion: 2.20 time: 0.201055 Dec 24 10:45:24.757968 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 37/69] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Dec 24 10:45:24 2021] GET /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0 => generated 1282 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 10:45:24.922814 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-663d45da-2e9f-4c25-be1a-32ac5a85143a tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:45:24.923833 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-663d45da-2e9f-4c25-be1a-32ac5a85143a tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] [instance: f77538c5-1e85-4d4f-b6cb-1c003149fac1] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:45:24.941590 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-663d45da-2e9f-4c25-be1a-32ac5a85143a tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:45:24.945294 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-663d45da-2e9f-4c25-be1a-32ac5a85143a tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:45:24.947365 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-663d45da-2e9f-4c25-be1a-32ac5a85143a tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:45:24.947365 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-663d45da-2e9f-4c25-be1a-32ac5a85143a tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:45:25.096149 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-8c7c4e6c-d531-45f4-a499-4b66113a4b45 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ad5096717dc425c849dfe95ea55a6af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62d11172cdf4959a15ac1ffc5601aca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:45:25.116413 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-8c7c4e6c-d531-45f4-a499-4b66113a4b45 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] 10.222.0.30 "GET /compute/v2.1/servers/b18ab8db-0c1f-4343-ae07-953fc820b211" status: 200 len: 1317 microversion: 2.1 time: 0.843732 Dec 24 10:45:25.130564 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 33/70] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:45:24 2021] GET /compute/v2.1/servers/b18ab8db-0c1f-4343-ae07-953fc820b211 => generated 1317 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:45:25.543347 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-865e1534-8c44-4131-b959-87ccf7780bf8 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:45:25.544368 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-865e1534-8c44-4131-b959-87ccf7780bf8 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] [instance: c2c661f2-d3da-4357-a7a8-3f85fc94cc60] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:45:25.553255 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-865e1534-8c44-4131-b959-87ccf7780bf8 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:45:25.560580 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-865e1534-8c44-4131-b959-87ccf7780bf8 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:45:25.567841 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-865e1534-8c44-4131-b959-87ccf7780bf8 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:45:25.568408 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-865e1534-8c44-4131-b959-87ccf7780bf8 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:45:25.880561 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-663d45da-2e9f-4c25-be1a-32ac5a85143a tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75a06733f5d4b7e8044fe6a9914a5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52385c4779dd49e7b3f0d9e56a8d2d26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:45:25.898340 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-663d45da-2e9f-4c25-be1a-32ac5a85143a tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] 10.222.0.30 "GET /compute/v2.1/servers/f77538c5-1e85-4d4f-b6cb-1c003149fac1" status: 200 len: 1315 microversion: 2.1 time: 0.987641 Dec 24 10:45:25.898973 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 38/71] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:45:24 2021] GET /compute/v2.1/servers/f77538c5-1e85-4d4f-b6cb-1c003149fac1 => generated 1315 bytes in 991 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 24 10:45:25.903867 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-118857df-f4a3-41f5-a177-af50d58f6df6 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:45:25.912503 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-118857df-f4a3-41f5-a177-af50d58f6df6 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] [instance: a99a6a98-4010-4f8e-a83f-fcc490f6ece0] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:45:25.954644 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-865e1534-8c44-4131-b959-87ccf7780bf8 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d627b760f74f48ac560e2ce2e74e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '378bb44ad89440e49f7e290a5d31004e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:45:25.994110 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-865e1534-8c44-4131-b959-87ccf7780bf8 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] 10.222.0.30 "GET /compute/v2.1/servers/c2c661f2-d3da-4357-a7a8-3f85fc94cc60" status: 200 len: 1322 microversion: 2.1 time: 0.454626 Dec 24 10:45:26.019244 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 34/72] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:45:25 2021] GET /compute/v2.1/servers/c2c661f2-d3da-4357-a7a8-3f85fc94cc60 => generated 1322 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:45:26.019789 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [req-d0a0fa8e-6e5a-4da2-858e-e6a5944a3a64 req-f4896db6-a751-4844-8d57-5f667a4f4f99 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c2c661f2-d3da-4357-a7a8-3f85fc94cc60", "tag": "11e42488-46c0-47e4-b7d6-51ddfdde57c9"}]} {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:45:26.021809 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 10:45:26.021809 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: warnings.warn(msg) Dec 24 10:45:26.040048 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [req-d0a0fa8e-6e5a-4da2-858e-e6a5944a3a64 req-f4896db6-a751-4844-8d57-5f667a4f4f99 service nova] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:45:26.040554 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [req-d0a0fa8e-6e5a-4da2-858e-e6a5944a3a64 req-f4896db6-a751-4844-8d57-5f667a4f4f99 service nova] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:45:26.055841 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.compute.server_external_events [req-d0a0fa8e-6e5a-4da2-858e-e6a5944a3a64 req-f4896db6-a751-4844-8d57-5f667a4f4f99 service nova] Creating event network-changed:11e42488-46c0-47e4-b7d6-51ddfdde57c9 for instance c2c661f2-d3da-4357-a7a8-3f85fc94cc60 on hv-cinder-81644 Dec 24 10:45:26.064036 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [req-d0a0fa8e-6e5a-4da2-858e-e6a5944a3a64 req-f4896db6-a751-4844-8d57-5f667a4f4f99 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048512 Dec 24 10:45:26.067055 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 35/73] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Dec 24 10:45:26 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 10:45:26.108970 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-118857df-f4a3-41f5-a177-af50d58f6df6 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:45:26.121241 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-118857df-f4a3-41f5-a177-af50d58f6df6 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:45:26.123160 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-118857df-f4a3-41f5-a177-af50d58f6df6 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:45:26.125432 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-118857df-f4a3-41f5-a177-af50d58f6df6 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] 10.222.0.30 "GET /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0" status: 200 len: 1282 microversion: 2.20 time: 0.225066 Dec 24 10:45:26.126676 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 39/74] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Dec 24 10:45:25 2021] GET /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0 => generated 1282 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 10:45:26.138175 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-b4638e86-54e6-402e-a46d-f1ef80d42dfd tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:45:26.139100 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-b4638e86-54e6-402e-a46d-f1ef80d42dfd tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] [instance: b18ab8db-0c1f-4343-ae07-953fc820b211] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:45:26.148928 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-b4638e86-54e6-402e-a46d-f1ef80d42dfd tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:45:26.149839 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-b4638e86-54e6-402e-a46d-f1ef80d42dfd tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:45:26.153891 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-b4638e86-54e6-402e-a46d-f1ef80d42dfd tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:45:26.155596 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-b4638e86-54e6-402e-a46d-f1ef80d42dfd tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:45:26.346163 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-b4638e86-54e6-402e-a46d-f1ef80d42dfd tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ad5096717dc425c849dfe95ea55a6af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62d11172cdf4959a15ac1ffc5601aca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:45:26.354303 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-b4638e86-54e6-402e-a46d-f1ef80d42dfd tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] 10.222.0.30 "GET /compute/v2.1/servers/b18ab8db-0c1f-4343-ae07-953fc820b211" status: 200 len: 1317 microversion: 2.1 time: 0.220234 Dec 24 10:45:26.354969 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 36/75] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:45:26 2021] GET /compute/v2.1/servers/b18ab8db-0c1f-4343-ae07-953fc820b211 => generated 1317 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:45:27.230201 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-9c4b31b6-c606-436a-a95f-d5adf77e24e3 tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:45:27.230201 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-9c4b31b6-c606-436a-a95f-d5adf77e24e3 tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] [instance: f77538c5-1e85-4d4f-b6cb-1c003149fac1] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:45:27.230201 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-9c4b31b6-c606-436a-a95f-d5adf77e24e3 tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:45:27.230201 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-9c4b31b6-c606-436a-a95f-d5adf77e24e3 tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:45:27.231376 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-9c4b31b6-c606-436a-a95f-d5adf77e24e3 tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:45:27.231376 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-9c4b31b6-c606-436a-a95f-d5adf77e24e3 tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:45:27.231527 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-b8affbc1-fdf4-469c-911a-117380e36835 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:45:27.231527 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-b8affbc1-fdf4-469c-911a-117380e36835 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] [instance: c2c661f2-d3da-4357-a7a8-3f85fc94cc60] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:45:27.231527 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-b8affbc1-fdf4-469c-911a-117380e36835 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:45:27.231527 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-b8affbc1-fdf4-469c-911a-117380e36835 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:45:27.232198 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-b8affbc1-fdf4-469c-911a-117380e36835 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:45:27.232198 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-b8affbc1-fdf4-469c-911a-117380e36835 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:45:27.232336 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-9c4b31b6-c606-436a-a95f-d5adf77e24e3 tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75a06733f5d4b7e8044fe6a9914a5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52385c4779dd49e7b3f0d9e56a8d2d26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:45:27.232336 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-9c4b31b6-c606-436a-a95f-d5adf77e24e3 tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] 10.222.0.30 "GET /compute/v2.1/servers/f77538c5-1e85-4d4f-b6cb-1c003149fac1" status: 200 len: 1315 microversion: 2.1 time: 0.153006 Dec 24 10:45:27.232336 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 40/76] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:45:26 2021] GET /compute/v2.1/servers/f77538c5-1e85-4d4f-b6cb-1c003149fac1 => generated 1315 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:45:27.232336 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-f513252e-67bc-42e2-b962-f94359e75a27 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:45:27.232634 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-f513252e-67bc-42e2-b962-f94359e75a27 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] [instance: a99a6a98-4010-4f8e-a83f-fcc490f6ece0] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:45:27.232810 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-b8affbc1-fdf4-469c-911a-117380e36835 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d627b760f74f48ac560e2ce2e74e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '378bb44ad89440e49f7e290a5d31004e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:45:27.232940 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-f513252e-67bc-42e2-b962-f94359e75a27 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:45:27.232940 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-f513252e-67bc-42e2-b962-f94359e75a27 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:45:27.232940 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-f513252e-67bc-42e2-b962-f94359e75a27 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:45:27.232940 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-f513252e-67bc-42e2-b962-f94359e75a27 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:45:27.233226 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-b8affbc1-fdf4-469c-911a-117380e36835 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] 10.222.0.30 "GET /compute/v2.1/servers/c2c661f2-d3da-4357-a7a8-3f85fc94cc60" status: 200 len: 1322 microversion: 2.1 time: 0.154519 Dec 24 10:45:27.233226 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 37/77] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:45:27 2021] GET /compute/v2.1/servers/c2c661f2-d3da-4357-a7a8-3f85fc94cc60 => generated 1322 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:45:27.271550 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-f513252e-67bc-42e2-b962-f94359e75a27 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:45:27.288688 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-f513252e-67bc-42e2-b962-f94359e75a27 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:45:27.290510 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-f513252e-67bc-42e2-b962-f94359e75a27 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:45:27.292767 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-f513252e-67bc-42e2-b962-f94359e75a27 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] 10.222.0.30 "GET /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0" status: 200 len: 1286 microversion: 2.20 time: 0.150875 Dec 24 10:45:27.293522 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 41/78] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Dec 24 10:45:27 2021] GET /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0 => generated 1286 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 24 10:45:27.371725 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-949419d9-b401-44c8-8021-9e5fc3274685 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:45:27.372519 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-949419d9-b401-44c8-8021-9e5fc3274685 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] [instance: b18ab8db-0c1f-4343-ae07-953fc820b211] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:45:27.379040 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-949419d9-b401-44c8-8021-9e5fc3274685 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:45:27.379505 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-949419d9-b401-44c8-8021-9e5fc3274685 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:45:27.380306 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-949419d9-b401-44c8-8021-9e5fc3274685 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:45:27.380793 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-949419d9-b401-44c8-8021-9e5fc3274685 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:45:27.694215 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-949419d9-b401-44c8-8021-9e5fc3274685 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ad5096717dc425c849dfe95ea55a6af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62d11172cdf4959a15ac1ffc5601aca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:45:27.709575 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-949419d9-b401-44c8-8021-9e5fc3274685 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] 10.222.0.30 "GET /compute/v2.1/servers/b18ab8db-0c1f-4343-ae07-953fc820b211" status: 200 len: 1317 microversion: 2.1 time: 0.341304 Dec 24 10:45:27.710362 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 38/79] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:45:27 2021] GET /compute/v2.1/servers/b18ab8db-0c1f-4343-ae07-953fc820b211 => generated 1317 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:45:28.231193 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-8b66ecb0-d80c-46fd-8831-bf78cfcfc894 tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:45:28.231826 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-8b66ecb0-d80c-46fd-8831-bf78cfcfc894 tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] [instance: f77538c5-1e85-4d4f-b6cb-1c003149fac1] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:45:28.237805 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-8b66ecb0-d80c-46fd-8831-bf78cfcfc894 tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:45:28.238252 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-8b66ecb0-d80c-46fd-8831-bf78cfcfc894 tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:45:28.238579 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-a06a4072-cc93-41a3-a452-93558174b6cf tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:45:28.239114 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-8b66ecb0-d80c-46fd-8831-bf78cfcfc894 tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:45:28.239230 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-a06a4072-cc93-41a3-a452-93558174b6cf tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] [instance: c2c661f2-d3da-4357-a7a8-3f85fc94cc60] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:45:28.239463 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-8b66ecb0-d80c-46fd-8831-bf78cfcfc894 tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:45:28.246275 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-a06a4072-cc93-41a3-a452-93558174b6cf tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:45:28.246572 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-a06a4072-cc93-41a3-a452-93558174b6cf tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:45:28.247383 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-a06a4072-cc93-41a3-a452-93558174b6cf tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:45:28.247821 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-a06a4072-cc93-41a3-a452-93558174b6cf tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:45:28.430539 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-8b66ecb0-d80c-46fd-8831-bf78cfcfc894 tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75a06733f5d4b7e8044fe6a9914a5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52385c4779dd49e7b3f0d9e56a8d2d26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:45:28.443897 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-8b66ecb0-d80c-46fd-8831-bf78cfcfc894 tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] 10.222.0.30 "GET /compute/v2.1/servers/f77538c5-1e85-4d4f-b6cb-1c003149fac1" status: 200 len: 1315 microversion: 2.1 time: 0.215251 Dec 24 10:45:28.444871 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 42/80] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:45:28 2021] GET /compute/v2.1/servers/f77538c5-1e85-4d4f-b6cb-1c003149fac1 => generated 1315 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 24 10:45:28.465694 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-d3652f80-92b3-47ed-9e72-2fbff001e1dc tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:45:28.466882 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-d3652f80-92b3-47ed-9e72-2fbff001e1dc tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] [instance: a99a6a98-4010-4f8e-a83f-fcc490f6ece0] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:45:28.478947 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-a06a4072-cc93-41a3-a452-93558174b6cf tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d627b760f74f48ac560e2ce2e74e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '378bb44ad89440e49f7e290a5d31004e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:45:28.483162 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-d3652f80-92b3-47ed-9e72-2fbff001e1dc tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:45:28.483590 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-d3652f80-92b3-47ed-9e72-2fbff001e1dc tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:45:28.488052 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-a06a4072-cc93-41a3-a452-93558174b6cf tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] 10.222.0.30 "GET /compute/v2.1/servers/c2c661f2-d3da-4357-a7a8-3f85fc94cc60" status: 200 len: 1322 microversion: 2.1 time: 0.253044 Dec 24 10:45:28.495532 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 39/81] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:45:28 2021] GET /compute/v2.1/servers/c2c661f2-d3da-4357-a7a8-3f85fc94cc60 => generated 1322 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 24 10:45:28.495849 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-d3652f80-92b3-47ed-9e72-2fbff001e1dc tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:45:28.495849 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-d3652f80-92b3-47ed-9e72-2fbff001e1dc tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:45:28.569144 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-d3652f80-92b3-47ed-9e72-2fbff001e1dc tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:45:28.585147 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-d3652f80-92b3-47ed-9e72-2fbff001e1dc tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:45:28.586971 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-d3652f80-92b3-47ed-9e72-2fbff001e1dc tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:45:28.588878 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-d3652f80-92b3-47ed-9e72-2fbff001e1dc tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] 10.222.0.30 "GET /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0" status: 200 len: 1286 microversion: 2.20 time: 0.142323 Dec 24 10:45:28.590067 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 43/82] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Dec 24 10:45:28 2021] GET /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0 => generated 1286 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 10:45:28.726938 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-297d3db4-c0fa-4abc-8b50-5e170f114592 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:45:28.727549 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-297d3db4-c0fa-4abc-8b50-5e170f114592 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] [instance: b18ab8db-0c1f-4343-ae07-953fc820b211] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:45:28.733407 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-297d3db4-c0fa-4abc-8b50-5e170f114592 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:45:28.733850 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-297d3db4-c0fa-4abc-8b50-5e170f114592 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:45:28.734837 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-297d3db4-c0fa-4abc-8b50-5e170f114592 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:45:28.735260 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-297d3db4-c0fa-4abc-8b50-5e170f114592 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:45:28.970783 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-297d3db4-c0fa-4abc-8b50-5e170f114592 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ad5096717dc425c849dfe95ea55a6af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62d11172cdf4959a15ac1ffc5601aca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:45:28.984087 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-297d3db4-c0fa-4abc-8b50-5e170f114592 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] 10.222.0.30 "GET /compute/v2.1/servers/b18ab8db-0c1f-4343-ae07-953fc820b211" status: 200 len: 1317 microversion: 2.1 time: 0.261325 Dec 24 10:45:28.986213 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 40/83] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:45:28 2021] GET /compute/v2.1/servers/b18ab8db-0c1f-4343-ae07-953fc820b211 => generated 1317 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:45:29.464671 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-658b3c6c-53f5-45e0-b21d-480f4e77ebe6 tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:45:29.465294 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-658b3c6c-53f5-45e0-b21d-480f4e77ebe6 tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] [instance: f77538c5-1e85-4d4f-b6cb-1c003149fac1] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:45:29.471031 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-658b3c6c-53f5-45e0-b21d-480f4e77ebe6 tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:45:29.471542 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-658b3c6c-53f5-45e0-b21d-480f4e77ebe6 tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:45:29.473015 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-658b3c6c-53f5-45e0-b21d-480f4e77ebe6 tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:45:29.473015 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-658b3c6c-53f5-45e0-b21d-480f4e77ebe6 tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:45:29.504744 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-5e7406eb-a897-4a41-8ea8-5d68bb78d665 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:45:29.505404 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-5e7406eb-a897-4a41-8ea8-5d68bb78d665 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] [instance: c2c661f2-d3da-4357-a7a8-3f85fc94cc60] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:45:29.511817 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-5e7406eb-a897-4a41-8ea8-5d68bb78d665 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:45:29.519079 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-5e7406eb-a897-4a41-8ea8-5d68bb78d665 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:45:29.519079 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-5e7406eb-a897-4a41-8ea8-5d68bb78d665 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:45:29.519079 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-5e7406eb-a897-4a41-8ea8-5d68bb78d665 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:45:29.645354 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-658b3c6c-53f5-45e0-b21d-480f4e77ebe6 tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75a06733f5d4b7e8044fe6a9914a5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52385c4779dd49e7b3f0d9e56a8d2d26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:45:29.648127 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-5e7406eb-a897-4a41-8ea8-5d68bb78d665 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d627b760f74f48ac560e2ce2e74e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '378bb44ad89440e49f7e290a5d31004e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:45:29.652200 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-658b3c6c-53f5-45e0-b21d-480f4e77ebe6 tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] 10.222.0.30 "GET /compute/v2.1/servers/f77538c5-1e85-4d4f-b6cb-1c003149fac1" status: 200 len: 1315 microversion: 2.1 time: 0.190614 Dec 24 10:45:29.653039 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 44/84] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:45:29 2021] GET /compute/v2.1/servers/f77538c5-1e85-4d4f-b6cb-1c003149fac1 => generated 1315 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:45:29.656170 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-5e7406eb-a897-4a41-8ea8-5d68bb78d665 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] 10.222.0.30 "GET /compute/v2.1/servers/c2c661f2-d3da-4357-a7a8-3f85fc94cc60" status: 200 len: 1322 microversion: 2.1 time: 0.155331 Dec 24 10:45:29.656722 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 41/85] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:45:29 2021] GET /compute/v2.1/servers/c2c661f2-d3da-4357-a7a8-3f85fc94cc60 => generated 1322 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 24 10:45:29.665754 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-41ccbad2-6697-46d1-a122-986c6ff77a6e tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:45:29.666363 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-41ccbad2-6697-46d1-a122-986c6ff77a6e tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] [instance: a99a6a98-4010-4f8e-a83f-fcc490f6ece0] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:45:29.673153 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-41ccbad2-6697-46d1-a122-986c6ff77a6e tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:45:29.682972 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-41ccbad2-6697-46d1-a122-986c6ff77a6e tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:45:29.682972 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-41ccbad2-6697-46d1-a122-986c6ff77a6e tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:45:29.682972 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-41ccbad2-6697-46d1-a122-986c6ff77a6e tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:45:29.740568 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-41ccbad2-6697-46d1-a122-986c6ff77a6e tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:45:29.748432 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-41ccbad2-6697-46d1-a122-986c6ff77a6e tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:45:29.749965 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-41ccbad2-6697-46d1-a122-986c6ff77a6e tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:45:29.751426 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-41ccbad2-6697-46d1-a122-986c6ff77a6e tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] 10.222.0.30 "GET /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0" status: 200 len: 1342 microversion: 2.20 time: 0.096877 Dec 24 10:45:29.752574 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 45/86] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Dec 24 10:45:29 2021] GET /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0 => generated 1342 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 10:45:30.003889 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-5fa4abe8-2502-421f-8ec6-e2951bfb5cda tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:45:30.004513 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-5fa4abe8-2502-421f-8ec6-e2951bfb5cda tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] [instance: b18ab8db-0c1f-4343-ae07-953fc820b211] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:45:30.013671 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-5fa4abe8-2502-421f-8ec6-e2951bfb5cda tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:45:30.017323 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-5fa4abe8-2502-421f-8ec6-e2951bfb5cda tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:45:30.018341 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-5fa4abe8-2502-421f-8ec6-e2951bfb5cda tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:45:30.018849 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-5fa4abe8-2502-421f-8ec6-e2951bfb5cda tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:45:30.222985 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-5fa4abe8-2502-421f-8ec6-e2951bfb5cda tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ad5096717dc425c849dfe95ea55a6af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62d11172cdf4959a15ac1ffc5601aca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:45:30.256460 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-5fa4abe8-2502-421f-8ec6-e2951bfb5cda tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] 10.222.0.30 "GET /compute/v2.1/servers/b18ab8db-0c1f-4343-ae07-953fc820b211" status: 200 len: 1317 microversion: 2.1 time: 0.235680 Dec 24 10:45:30.256460 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 42/87] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:45:29 2021] GET /compute/v2.1/servers/b18ab8db-0c1f-4343-ae07-953fc820b211 => generated 1317 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:45:30.669236 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-247402a3-fa04-41fc-a45d-4092136ae1ca tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:45:30.669909 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-247402a3-fa04-41fc-a45d-4092136ae1ca tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] [instance: f77538c5-1e85-4d4f-b6cb-1c003149fac1] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:45:30.672409 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-f4a0f9d4-f41c-46ee-b2f7-5802a2bc204c tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:45:30.673165 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-f4a0f9d4-f41c-46ee-b2f7-5802a2bc204c tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] [instance: c2c661f2-d3da-4357-a7a8-3f85fc94cc60] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:45:30.676429 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-247402a3-fa04-41fc-a45d-4092136ae1ca tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:45:30.676918 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-247402a3-fa04-41fc-a45d-4092136ae1ca tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:45:30.678364 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-247402a3-fa04-41fc-a45d-4092136ae1ca tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:45:30.678780 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-247402a3-fa04-41fc-a45d-4092136ae1ca tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:45:30.679408 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-f4a0f9d4-f41c-46ee-b2f7-5802a2bc204c tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:45:30.679856 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-f4a0f9d4-f41c-46ee-b2f7-5802a2bc204c tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:45:30.680666 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-f4a0f9d4-f41c-46ee-b2f7-5802a2bc204c tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:45:30.681128 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-f4a0f9d4-f41c-46ee-b2f7-5802a2bc204c tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:45:30.834734 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-247402a3-fa04-41fc-a45d-4092136ae1ca tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75a06733f5d4b7e8044fe6a9914a5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52385c4779dd49e7b3f0d9e56a8d2d26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:45:30.842289 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-247402a3-fa04-41fc-a45d-4092136ae1ca tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] 10.222.0.30 "GET /compute/v2.1/servers/f77538c5-1e85-4d4f-b6cb-1c003149fac1" status: 200 len: 1315 microversion: 2.1 time: 0.177180 Dec 24 10:45:30.843031 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 46/88] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:45:30 2021] GET /compute/v2.1/servers/f77538c5-1e85-4d4f-b6cb-1c003149fac1 => generated 1315 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:45:30.848158 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-faf6f649-440e-4f12-ba64-f5feaeb6528d tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:45:30.849039 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-faf6f649-440e-4f12-ba64-f5feaeb6528d tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] [instance: a99a6a98-4010-4f8e-a83f-fcc490f6ece0] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:45:30.856020 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-faf6f649-440e-4f12-ba64-f5feaeb6528d tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:45:30.856709 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-faf6f649-440e-4f12-ba64-f5feaeb6528d tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:45:30.860878 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-faf6f649-440e-4f12-ba64-f5feaeb6528d tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:45:30.860878 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-faf6f649-440e-4f12-ba64-f5feaeb6528d tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:45:30.926926 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-f4a0f9d4-f41c-46ee-b2f7-5802a2bc204c tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d627b760f74f48ac560e2ce2e74e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '378bb44ad89440e49f7e290a5d31004e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:45:30.936476 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-f4a0f9d4-f41c-46ee-b2f7-5802a2bc204c tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] 10.222.0.30 "GET /compute/v2.1/servers/c2c661f2-d3da-4357-a7a8-3f85fc94cc60" status: 200 len: 1322 microversion: 2.1 time: 0.267653 Dec 24 10:45:30.937438 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 43/89] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:45:30 2021] GET /compute/v2.1/servers/c2c661f2-d3da-4357-a7a8-3f85fc94cc60 => generated 1322 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 24 10:45:31.000710 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-faf6f649-440e-4f12-ba64-f5feaeb6528d tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:45:31.007216 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-faf6f649-440e-4f12-ba64-f5feaeb6528d tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:45:31.008692 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-faf6f649-440e-4f12-ba64-f5feaeb6528d tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:45:31.009985 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-faf6f649-440e-4f12-ba64-f5feaeb6528d tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] 10.222.0.30 "GET /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0" status: 200 len: 1407 microversion: 2.20 time: 0.166050 Dec 24 10:45:31.010542 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 47/90] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Dec 24 10:45:30 2021] GET /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0 => generated 1407 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 10:45:31.277637 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-f28429fa-aef6-4fa4-8ad5-7a452dc183dd tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:45:31.279150 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-f28429fa-aef6-4fa4-8ad5-7a452dc183dd tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] [instance: b18ab8db-0c1f-4343-ae07-953fc820b211] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:45:31.291666 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-f28429fa-aef6-4fa4-8ad5-7a452dc183dd tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:45:31.292648 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-f28429fa-aef6-4fa4-8ad5-7a452dc183dd tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:45:31.294474 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-f28429fa-aef6-4fa4-8ad5-7a452dc183dd tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:45:31.295459 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-f28429fa-aef6-4fa4-8ad5-7a452dc183dd tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:45:31.534518 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-f28429fa-aef6-4fa4-8ad5-7a452dc183dd tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ad5096717dc425c849dfe95ea55a6af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62d11172cdf4959a15ac1ffc5601aca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:45:31.541795 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-f28429fa-aef6-4fa4-8ad5-7a452dc183dd tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] 10.222.0.30 "GET /compute/v2.1/servers/b18ab8db-0c1f-4343-ae07-953fc820b211" status: 200 len: 1317 microversion: 2.1 time: 0.271609 Dec 24 10:45:31.542361 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 44/91] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:45:31 2021] GET /compute/v2.1/servers/b18ab8db-0c1f-4343-ae07-953fc820b211 => generated 1317 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:45:31.858752 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-7be79412-18da-479d-8a3a-ad2f35387bd8 tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:45:31.859469 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-7be79412-18da-479d-8a3a-ad2f35387bd8 tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] [instance: f77538c5-1e85-4d4f-b6cb-1c003149fac1] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:45:31.866043 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-7be79412-18da-479d-8a3a-ad2f35387bd8 tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:45:31.866561 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-7be79412-18da-479d-8a3a-ad2f35387bd8 tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:45:31.867416 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-7be79412-18da-479d-8a3a-ad2f35387bd8 tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:45:31.874241 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-7be79412-18da-479d-8a3a-ad2f35387bd8 tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:45:31.961291 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-8b567644-1f6d-43cd-8512-9efd9ab56454 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:45:31.962450 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-8b567644-1f6d-43cd-8512-9efd9ab56454 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] [instance: c2c661f2-d3da-4357-a7a8-3f85fc94cc60] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:45:31.968497 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-8b567644-1f6d-43cd-8512-9efd9ab56454 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:45:31.969174 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-8b567644-1f6d-43cd-8512-9efd9ab56454 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:45:31.970131 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-8b567644-1f6d-43cd-8512-9efd9ab56454 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:45:31.970774 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-8b567644-1f6d-43cd-8512-9efd9ab56454 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:45:32.014737 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-7be79412-18da-479d-8a3a-ad2f35387bd8 tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75a06733f5d4b7e8044fe6a9914a5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52385c4779dd49e7b3f0d9e56a8d2d26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:45:32.022804 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-7be79412-18da-479d-8a3a-ad2f35387bd8 tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] 10.222.0.30 "GET /compute/v2.1/servers/f77538c5-1e85-4d4f-b6cb-1c003149fac1" status: 200 len: 1315 microversion: 2.1 time: 0.167625 Dec 24 10:45:32.025187 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 48/92] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:45:31 2021] GET /compute/v2.1/servers/f77538c5-1e85-4d4f-b6cb-1c003149fac1 => generated 1315 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:45:32.036726 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-d636584e-9cec-4df6-8786-2f5c0241f639 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:45:32.037514 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-d636584e-9cec-4df6-8786-2f5c0241f639 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] [instance: a99a6a98-4010-4f8e-a83f-fcc490f6ece0] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:45:32.045218 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-d636584e-9cec-4df6-8786-2f5c0241f639 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:45:32.045678 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-d636584e-9cec-4df6-8786-2f5c0241f639 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:45:32.046620 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-d636584e-9cec-4df6-8786-2f5c0241f639 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:45:32.047058 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-d636584e-9cec-4df6-8786-2f5c0241f639 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:45:32.245450 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-d636584e-9cec-4df6-8786-2f5c0241f639 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:45:32.257608 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-d636584e-9cec-4df6-8786-2f5c0241f639 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:45:32.270713 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-d636584e-9cec-4df6-8786-2f5c0241f639 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:45:32.275426 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-d636584e-9cec-4df6-8786-2f5c0241f639 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] 10.222.0.30 "GET /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0" status: 200 len: 1407 microversion: 2.20 time: 0.243946 Dec 24 10:45:32.279228 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 49/93] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Dec 24 10:45:32 2021] GET /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0 => generated 1407 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 10:45:32.290241 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [req-51dd7c3b-52ee-4bde-9550-6732e082cb25 req-86d66f83-5221-4e6c-8c61-6221e390d211 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a99a6a98-4010-4f8e-a83f-fcc490f6ece0", "tag": "e50dfc57-62cb-4d13-9e17-f48edcdb1dcc"}]} {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:45:32.298682 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 10:45:32.298682 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: warnings.warn(msg) Dec 24 10:45:32.317628 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [req-51dd7c3b-52ee-4bde-9550-6732e082cb25 req-86d66f83-5221-4e6c-8c61-6221e390d211 service nova] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:45:32.318172 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [req-51dd7c3b-52ee-4bde-9550-6732e082cb25 req-86d66f83-5221-4e6c-8c61-6221e390d211 service nova] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:45:32.358138 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.compute.server_external_events [req-51dd7c3b-52ee-4bde-9550-6732e082cb25 req-86d66f83-5221-4e6c-8c61-6221e390d211 service nova] Creating event network-changed:e50dfc57-62cb-4d13-9e17-f48edcdb1dcc for instance a99a6a98-4010-4f8e-a83f-fcc490f6ece0 on hv-cinder-81644 Dec 24 10:45:32.362816 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [req-51dd7c3b-52ee-4bde-9550-6732e082cb25 req-86d66f83-5221-4e6c-8c61-6221e390d211 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081053 Dec 24 10:45:32.363706 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 50/94] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Dec 24 10:45:32 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 10:45:32.472704 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-8b567644-1f6d-43cd-8512-9efd9ab56454 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d627b760f74f48ac560e2ce2e74e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '378bb44ad89440e49f7e290a5d31004e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:45:32.485856 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-8b567644-1f6d-43cd-8512-9efd9ab56454 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] 10.222.0.30 "GET /compute/v2.1/servers/c2c661f2-d3da-4357-a7a8-3f85fc94cc60" status: 200 len: 1322 microversion: 2.1 time: 0.533675 Dec 24 10:45:32.500101 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 45/95] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:45:31 2021] GET /compute/v2.1/servers/c2c661f2-d3da-4357-a7a8-3f85fc94cc60 => generated 1322 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 24 10:45:32.562452 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-28f1ab6a-363a-475f-a194-0849fcc113b8 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:45:32.563997 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-28f1ab6a-363a-475f-a194-0849fcc113b8 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] [instance: b18ab8db-0c1f-4343-ae07-953fc820b211] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:45:32.571196 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-28f1ab6a-363a-475f-a194-0849fcc113b8 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:45:32.571647 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-28f1ab6a-363a-475f-a194-0849fcc113b8 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:45:32.572616 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-28f1ab6a-363a-475f-a194-0849fcc113b8 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:45:32.573089 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-28f1ab6a-363a-475f-a194-0849fcc113b8 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:45:32.723677 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-28f1ab6a-363a-475f-a194-0849fcc113b8 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ad5096717dc425c849dfe95ea55a6af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62d11172cdf4959a15ac1ffc5601aca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:45:32.731461 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-28f1ab6a-363a-475f-a194-0849fcc113b8 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] 10.222.0.30 "GET /compute/v2.1/servers/b18ab8db-0c1f-4343-ae07-953fc820b211" status: 200 len: 1317 microversion: 2.1 time: 0.176625 Dec 24 10:45:32.732021 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 51/96] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:45:32 2021] GET /compute/v2.1/servers/b18ab8db-0c1f-4343-ae07-953fc820b211 => generated 1317 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:45:33.039315 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-4460ee3b-fa13-4067-b203-8dcdc32b0392 tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:45:33.040013 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-4460ee3b-fa13-4067-b203-8dcdc32b0392 tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] [instance: f77538c5-1e85-4d4f-b6cb-1c003149fac1] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:45:33.046129 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-4460ee3b-fa13-4067-b203-8dcdc32b0392 tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:45:33.046665 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-4460ee3b-fa13-4067-b203-8dcdc32b0392 tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:45:33.047514 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-4460ee3b-fa13-4067-b203-8dcdc32b0392 tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:45:33.047951 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-4460ee3b-fa13-4067-b203-8dcdc32b0392 tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:45:33.298688 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-4460ee3b-fa13-4067-b203-8dcdc32b0392 tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75a06733f5d4b7e8044fe6a9914a5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52385c4779dd49e7b3f0d9e56a8d2d26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:45:33.310356 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-76c7ef25-cf92-4f66-9f62-a3f6f27ad1d7 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:45:33.311274 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-4460ee3b-fa13-4067-b203-8dcdc32b0392 tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] 10.222.0.30 "GET /compute/v2.1/servers/f77538c5-1e85-4d4f-b6cb-1c003149fac1" status: 200 len: 1315 microversion: 2.1 time: 0.275573 Dec 24 10:45:33.311567 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-76c7ef25-cf92-4f66-9f62-a3f6f27ad1d7 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] [instance: a99a6a98-4010-4f8e-a83f-fcc490f6ece0] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:45:33.312413 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 46/97] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:45:33 2021] GET /compute/v2.1/servers/f77538c5-1e85-4d4f-b6cb-1c003149fac1 => generated 1315 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:45:33.334304 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-76c7ef25-cf92-4f66-9f62-a3f6f27ad1d7 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:45:33.334304 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-76c7ef25-cf92-4f66-9f62-a3f6f27ad1d7 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:45:33.334304 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-76c7ef25-cf92-4f66-9f62-a3f6f27ad1d7 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:45:33.334622 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-76c7ef25-cf92-4f66-9f62-a3f6f27ad1d7 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:45:33.502087 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-76c7ef25-cf92-4f66-9f62-a3f6f27ad1d7 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:45:33.513235 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-76c7ef25-cf92-4f66-9f62-a3f6f27ad1d7 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:45:33.515428 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-76c7ef25-cf92-4f66-9f62-a3f6f27ad1d7 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:45:33.517153 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-76c7ef25-cf92-4f66-9f62-a3f6f27ad1d7 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] 10.222.0.30 "GET /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0" status: 200 len: 1407 microversion: 2.20 time: 0.214689 Dec 24 10:45:33.517323 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 52/98] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Dec 24 10:45:33 2021] GET /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0 => generated 1407 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 24 10:45:33.545762 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-5d5a849b-184b-43e1-b849-d8890685d953 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:45:33.546396 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-5d5a849b-184b-43e1-b849-d8890685d953 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] [instance: c2c661f2-d3da-4357-a7a8-3f85fc94cc60] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:45:33.559564 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-5d5a849b-184b-43e1-b849-d8890685d953 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:45:33.560332 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-5d5a849b-184b-43e1-b849-d8890685d953 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:45:33.561353 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-5d5a849b-184b-43e1-b849-d8890685d953 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:45:33.561971 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-5d5a849b-184b-43e1-b849-d8890685d953 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:45:33.748514 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-5f213dd0-006d-42f9-84d7-d92506c250c5 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:45:33.749155 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-5f213dd0-006d-42f9-84d7-d92506c250c5 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] [instance: b18ab8db-0c1f-4343-ae07-953fc820b211] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:45:33.754913 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-5f213dd0-006d-42f9-84d7-d92506c250c5 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:45:33.755360 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-5f213dd0-006d-42f9-84d7-d92506c250c5 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:45:33.756358 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-5f213dd0-006d-42f9-84d7-d92506c250c5 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:45:33.756785 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-5f213dd0-006d-42f9-84d7-d92506c250c5 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:45:33.804494 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-5d5a849b-184b-43e1-b849-d8890685d953 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d627b760f74f48ac560e2ce2e74e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '378bb44ad89440e49f7e290a5d31004e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:45:33.812326 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-5d5a849b-184b-43e1-b849-d8890685d953 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] 10.222.0.30 "GET /compute/v2.1/servers/c2c661f2-d3da-4357-a7a8-3f85fc94cc60" status: 200 len: 1322 microversion: 2.1 time: 0.272069 Dec 24 10:45:33.822343 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 47/99] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:45:33 2021] GET /compute/v2.1/servers/c2c661f2-d3da-4357-a7a8-3f85fc94cc60 => generated 1322 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:45:33.914979 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-5f213dd0-006d-42f9-84d7-d92506c250c5 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ad5096717dc425c849dfe95ea55a6af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62d11172cdf4959a15ac1ffc5601aca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:45:33.923631 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-5f213dd0-006d-42f9-84d7-d92506c250c5 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] 10.222.0.30 "GET /compute/v2.1/servers/b18ab8db-0c1f-4343-ae07-953fc820b211" status: 200 len: 1317 microversion: 2.1 time: 0.178678 Dec 24 10:45:33.939631 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 53/100] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:45:33 2021] GET /compute/v2.1/servers/b18ab8db-0c1f-4343-ae07-953fc820b211 => generated 1317 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 24 10:45:34.328651 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-2831a71d-24d0-4568-a13a-27ead5cc523a tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:45:34.329273 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-2831a71d-24d0-4568-a13a-27ead5cc523a tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] [instance: f77538c5-1e85-4d4f-b6cb-1c003149fac1] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:45:34.336031 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-2831a71d-24d0-4568-a13a-27ead5cc523a tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:45:34.336558 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-2831a71d-24d0-4568-a13a-27ead5cc523a tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:45:34.337516 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-2831a71d-24d0-4568-a13a-27ead5cc523a tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:45:34.338036 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-2831a71d-24d0-4568-a13a-27ead5cc523a tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:45:34.520611 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-2831a71d-24d0-4568-a13a-27ead5cc523a tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75a06733f5d4b7e8044fe6a9914a5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52385c4779dd49e7b3f0d9e56a8d2d26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:45:34.530654 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-2831a71d-24d0-4568-a13a-27ead5cc523a tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] 10.222.0.30 "GET /compute/v2.1/servers/f77538c5-1e85-4d4f-b6cb-1c003149fac1" status: 200 len: 1315 microversion: 2.1 time: 0.205252 Dec 24 10:45:34.531562 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 48/101] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:45:34 2021] GET /compute/v2.1/servers/f77538c5-1e85-4d4f-b6cb-1c003149fac1 => generated 1315 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 24 10:45:34.535928 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-54155c8f-4c31-4ff8-a73d-5e6ac138a1ce tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:45:34.537967 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-54155c8f-4c31-4ff8-a73d-5e6ac138a1ce tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] [instance: a99a6a98-4010-4f8e-a83f-fcc490f6ece0] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:45:34.544513 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-54155c8f-4c31-4ff8-a73d-5e6ac138a1ce tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:45:34.545545 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-54155c8f-4c31-4ff8-a73d-5e6ac138a1ce tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:45:34.546342 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-54155c8f-4c31-4ff8-a73d-5e6ac138a1ce tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:45:34.547668 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-54155c8f-4c31-4ff8-a73d-5e6ac138a1ce tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:45:34.759261 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-54155c8f-4c31-4ff8-a73d-5e6ac138a1ce tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:45:34.770476 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-54155c8f-4c31-4ff8-a73d-5e6ac138a1ce tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:45:34.773541 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-54155c8f-4c31-4ff8-a73d-5e6ac138a1ce tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:45:34.775760 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-54155c8f-4c31-4ff8-a73d-5e6ac138a1ce tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] 10.222.0.30 "GET /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0" status: 200 len: 1407 microversion: 2.20 time: 0.243788 Dec 24 10:45:34.776445 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 54/102] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Dec 24 10:45:34 2021] GET /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0 => generated 1407 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 10:45:34.831732 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-df8f84e9-e9ae-49ec-a012-543e228ba91b tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:45:34.833030 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-df8f84e9-e9ae-49ec-a012-543e228ba91b tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] [instance: c2c661f2-d3da-4357-a7a8-3f85fc94cc60] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:45:34.846802 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-df8f84e9-e9ae-49ec-a012-543e228ba91b tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:45:34.847301 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-df8f84e9-e9ae-49ec-a012-543e228ba91b tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:45:34.848700 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-df8f84e9-e9ae-49ec-a012-543e228ba91b tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:45:34.849907 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-df8f84e9-e9ae-49ec-a012-543e228ba91b tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:45:34.939754 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-bce9ea51-7e60-46ef-bc59-0dc301684706 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:45:34.940289 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-bce9ea51-7e60-46ef-bc59-0dc301684706 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] [instance: b18ab8db-0c1f-4343-ae07-953fc820b211] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:45:34.946408 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-bce9ea51-7e60-46ef-bc59-0dc301684706 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:45:34.947088 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-bce9ea51-7e60-46ef-bc59-0dc301684706 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:45:34.947864 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-bce9ea51-7e60-46ef-bc59-0dc301684706 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:45:34.948297 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-bce9ea51-7e60-46ef-bc59-0dc301684706 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:45:35.004838 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-df8f84e9-e9ae-49ec-a012-543e228ba91b tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d627b760f74f48ac560e2ce2e74e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '378bb44ad89440e49f7e290a5d31004e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:45:35.012946 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-df8f84e9-e9ae-49ec-a012-543e228ba91b tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] 10.222.0.30 "GET /compute/v2.1/servers/c2c661f2-d3da-4357-a7a8-3f85fc94cc60" status: 200 len: 1322 microversion: 2.1 time: 0.186109 Dec 24 10:45:35.013522 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 49/103] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:45:34 2021] GET /compute/v2.1/servers/c2c661f2-d3da-4357-a7a8-3f85fc94cc60 => generated 1322 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:45:35.092345 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-bce9ea51-7e60-46ef-bc59-0dc301684706 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ad5096717dc425c849dfe95ea55a6af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62d11172cdf4959a15ac1ffc5601aca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:45:35.106409 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-bce9ea51-7e60-46ef-bc59-0dc301684706 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] 10.222.0.30 "GET /compute/v2.1/servers/b18ab8db-0c1f-4343-ae07-953fc820b211" status: 200 len: 1317 microversion: 2.1 time: 0.168270 Dec 24 10:45:35.109912 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 55/104] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:45:34 2021] GET /compute/v2.1/servers/b18ab8db-0c1f-4343-ae07-953fc820b211 => generated 1317 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 24 10:45:35.547097 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-bb18430d-2a87-45e7-b439-59c67ceabe8b tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:45:35.547693 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-bb18430d-2a87-45e7-b439-59c67ceabe8b tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] [instance: f77538c5-1e85-4d4f-b6cb-1c003149fac1] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:45:35.554160 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-bb18430d-2a87-45e7-b439-59c67ceabe8b tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:45:35.554600 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-bb18430d-2a87-45e7-b439-59c67ceabe8b tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:45:35.555374 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-bb18430d-2a87-45e7-b439-59c67ceabe8b tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:45:35.555801 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-bb18430d-2a87-45e7-b439-59c67ceabe8b tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:45:35.717688 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-bb18430d-2a87-45e7-b439-59c67ceabe8b tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75a06733f5d4b7e8044fe6a9914a5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52385c4779dd49e7b3f0d9e56a8d2d26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:45:35.727119 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-bb18430d-2a87-45e7-b439-59c67ceabe8b tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] 10.222.0.30 "GET /compute/v2.1/servers/f77538c5-1e85-4d4f-b6cb-1c003149fac1" status: 200 len: 1315 microversion: 2.1 time: 0.183475 Dec 24 10:45:35.727790 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 50/105] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:45:35 2021] GET /compute/v2.1/servers/f77538c5-1e85-4d4f-b6cb-1c003149fac1 => generated 1315 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:45:35.794133 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-065637ea-5ff7-4e2d-b024-d9a857e4af7c tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:45:35.794803 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-065637ea-5ff7-4e2d-b024-d9a857e4af7c tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] [instance: a99a6a98-4010-4f8e-a83f-fcc490f6ece0] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:45:35.801875 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-065637ea-5ff7-4e2d-b024-d9a857e4af7c tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:45:35.802335 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-065637ea-5ff7-4e2d-b024-d9a857e4af7c tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:45:35.803755 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-065637ea-5ff7-4e2d-b024-d9a857e4af7c tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:45:35.804189 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-065637ea-5ff7-4e2d-b024-d9a857e4af7c tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:45:35.947872 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-065637ea-5ff7-4e2d-b024-d9a857e4af7c tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:45:35.956397 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-065637ea-5ff7-4e2d-b024-d9a857e4af7c tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:45:35.957929 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-065637ea-5ff7-4e2d-b024-d9a857e4af7c tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:45:35.959557 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-065637ea-5ff7-4e2d-b024-d9a857e4af7c tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] 10.222.0.30 "GET /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0" status: 200 len: 1407 microversion: 2.20 time: 0.169122 Dec 24 10:45:35.960114 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 56/106] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Dec 24 10:45:35 2021] GET /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0 => generated 1407 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 10:45:36.031782 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-899a7369-ad1d-46b6-8fe2-3361c4256adf tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:45:36.031782 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-899a7369-ad1d-46b6-8fe2-3361c4256adf tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] [instance: c2c661f2-d3da-4357-a7a8-3f85fc94cc60] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:45:36.035993 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-899a7369-ad1d-46b6-8fe2-3361c4256adf tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:45:36.036549 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-899a7369-ad1d-46b6-8fe2-3361c4256adf tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:45:36.037809 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-899a7369-ad1d-46b6-8fe2-3361c4256adf tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:45:36.038247 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-899a7369-ad1d-46b6-8fe2-3361c4256adf tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:45:36.125978 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-4462fd2b-5954-4234-a3b2-f7a8d20ec520 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:45:36.126606 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-4462fd2b-5954-4234-a3b2-f7a8d20ec520 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] [instance: b18ab8db-0c1f-4343-ae07-953fc820b211] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:45:36.132759 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-4462fd2b-5954-4234-a3b2-f7a8d20ec520 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:45:36.133247 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-4462fd2b-5954-4234-a3b2-f7a8d20ec520 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:45:36.134033 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-4462fd2b-5954-4234-a3b2-f7a8d20ec520 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:45:36.134720 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-4462fd2b-5954-4234-a3b2-f7a8d20ec520 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:45:36.176342 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-899a7369-ad1d-46b6-8fe2-3361c4256adf tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d627b760f74f48ac560e2ce2e74e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '378bb44ad89440e49f7e290a5d31004e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:45:36.184549 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-899a7369-ad1d-46b6-8fe2-3361c4256adf tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] 10.222.0.30 "GET /compute/v2.1/servers/c2c661f2-d3da-4357-a7a8-3f85fc94cc60" status: 200 len: 1322 microversion: 2.1 time: 0.158684 Dec 24 10:45:36.203079 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 51/107] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:45:36 2021] GET /compute/v2.1/servers/c2c661f2-d3da-4357-a7a8-3f85fc94cc60 => generated 1322 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 24 10:45:36.268258 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-4462fd2b-5954-4234-a3b2-f7a8d20ec520 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ad5096717dc425c849dfe95ea55a6af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62d11172cdf4959a15ac1ffc5601aca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:45:36.276600 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-4462fd2b-5954-4234-a3b2-f7a8d20ec520 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] 10.222.0.30 "GET /compute/v2.1/servers/b18ab8db-0c1f-4343-ae07-953fc820b211" status: 200 len: 1317 microversion: 2.1 time: 0.154561 Dec 24 10:45:36.277191 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 57/108] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:45:36 2021] GET /compute/v2.1/servers/b18ab8db-0c1f-4343-ae07-953fc820b211 => generated 1317 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 24 10:45:36.748072 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-ff0fe146-9df7-4498-b5a8-2da34ec74dc6 tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:45:36.748906 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-ff0fe146-9df7-4498-b5a8-2da34ec74dc6 tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] [instance: f77538c5-1e85-4d4f-b6cb-1c003149fac1] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:45:36.759240 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-ff0fe146-9df7-4498-b5a8-2da34ec74dc6 tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:45:36.760306 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-ff0fe146-9df7-4498-b5a8-2da34ec74dc6 tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:45:36.763262 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-ff0fe146-9df7-4498-b5a8-2da34ec74dc6 tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:45:36.763703 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-ff0fe146-9df7-4498-b5a8-2da34ec74dc6 tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:45:36.931943 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-ff0fe146-9df7-4498-b5a8-2da34ec74dc6 tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75a06733f5d4b7e8044fe6a9914a5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52385c4779dd49e7b3f0d9e56a8d2d26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:45:36.944282 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-ff0fe146-9df7-4498-b5a8-2da34ec74dc6 tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] 10.222.0.30 "GET /compute/v2.1/servers/f77538c5-1e85-4d4f-b6cb-1c003149fac1" status: 200 len: 1315 microversion: 2.1 time: 0.195758 Dec 24 10:45:36.944282 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 52/109] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:45:36 2021] GET /compute/v2.1/servers/f77538c5-1e85-4d4f-b6cb-1c003149fac1 => generated 1315 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:45:36.979535 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-23566b47-111f-48c8-ad2c-2351f454d278 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:45:36.980305 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-23566b47-111f-48c8-ad2c-2351f454d278 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] [instance: a99a6a98-4010-4f8e-a83f-fcc490f6ece0] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:45:36.986152 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-23566b47-111f-48c8-ad2c-2351f454d278 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:45:36.986600 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-23566b47-111f-48c8-ad2c-2351f454d278 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:45:36.987383 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-23566b47-111f-48c8-ad2c-2351f454d278 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:45:36.987859 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-23566b47-111f-48c8-ad2c-2351f454d278 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:45:37.153408 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-23566b47-111f-48c8-ad2c-2351f454d278 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:45:37.171513 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-23566b47-111f-48c8-ad2c-2351f454d278 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:45:37.173176 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-23566b47-111f-48c8-ad2c-2351f454d278 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:45:37.174379 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-23566b47-111f-48c8-ad2c-2351f454d278 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] 10.222.0.30 "GET /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0" status: 200 len: 1407 microversion: 2.20 time: 0.199156 Dec 24 10:45:37.174957 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 58/110] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Dec 24 10:45:36 2021] GET /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0 => generated 1407 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 10:45:37.202130 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-693c9bba-8e01-415c-bd2c-ddbe41e33941 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:45:37.203179 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-693c9bba-8e01-415c-bd2c-ddbe41e33941 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] [instance: c2c661f2-d3da-4357-a7a8-3f85fc94cc60] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:45:37.210194 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-693c9bba-8e01-415c-bd2c-ddbe41e33941 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:45:37.210902 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-693c9bba-8e01-415c-bd2c-ddbe41e33941 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:45:37.212364 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-693c9bba-8e01-415c-bd2c-ddbe41e33941 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:45:37.213056 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-693c9bba-8e01-415c-bd2c-ddbe41e33941 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:45:37.370614 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-693c9bba-8e01-415c-bd2c-ddbe41e33941 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d627b760f74f48ac560e2ce2e74e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '378bb44ad89440e49f7e290a5d31004e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:45:37.378041 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-693c9bba-8e01-415c-bd2c-ddbe41e33941 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] 10.222.0.30 "GET /compute/v2.1/servers/c2c661f2-d3da-4357-a7a8-3f85fc94cc60" status: 200 len: 1322 microversion: 2.1 time: 0.179744 Dec 24 10:45:37.378675 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 53/111] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:45:37 2021] GET /compute/v2.1/servers/c2c661f2-d3da-4357-a7a8-3f85fc94cc60 => generated 1322 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:45:37.383700 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-58778825-554d-45b9-b045-87336ac0c1c5 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:45:37.384449 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-58778825-554d-45b9-b045-87336ac0c1c5 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] [instance: b18ab8db-0c1f-4343-ae07-953fc820b211] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:45:37.392460 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [req-91b4c7e4-a496-4f35-be80-ea39c818da90 req-925b7acb-6b2e-4592-80a0-de6f3b141f32 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "54d2f913-8385-4f34-8cb0-8c0f08c7a30f", "name": "network-vif-plugged", "status": "completed", "tag": "44345f3a-e246-4a77-8d9d-bd7357043c0b"}]} {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:45:37.395159 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 10:45:37.395159 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: warnings.warn(msg) Dec 24 10:45:37.405321 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [req-91b4c7e4-a496-4f35-be80-ea39c818da90 req-925b7acb-6b2e-4592-80a0-de6f3b141f32 service nova] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:45:37.405768 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [req-91b4c7e4-a496-4f35-be80-ea39c818da90 req-925b7acb-6b2e-4592-80a0-de6f3b141f32 service nova] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:45:37.410616 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-58778825-554d-45b9-b045-87336ac0c1c5 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:45:37.411062 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-58778825-554d-45b9-b045-87336ac0c1c5 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:45:37.412378 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-58778825-554d-45b9-b045-87336ac0c1c5 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:45:37.412834 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-58778825-554d-45b9-b045-87336ac0c1c5 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:45:37.433108 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.compute.server_external_events [req-91b4c7e4-a496-4f35-be80-ea39c818da90 req-925b7acb-6b2e-4592-80a0-de6f3b141f32 service nova] Creating event network-vif-plugged:44345f3a-e246-4a77-8d9d-bd7357043c0b for instance 54d2f913-8385-4f34-8cb0-8c0f08c7a30f on hv-cinder-81644 Dec 24 10:45:37.444460 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [req-91b4c7e4-a496-4f35-be80-ea39c818da90 req-925b7acb-6b2e-4592-80a0-de6f3b141f32 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.212229 Dec 24 10:45:37.445388 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 59/112] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Dec 24 10:45:37 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 10:45:37.565957 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-58778825-554d-45b9-b045-87336ac0c1c5 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ad5096717dc425c849dfe95ea55a6af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62d11172cdf4959a15ac1ffc5601aca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:45:37.573123 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-58778825-554d-45b9-b045-87336ac0c1c5 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] 10.222.0.30 "GET /compute/v2.1/servers/b18ab8db-0c1f-4343-ae07-953fc820b211" status: 200 len: 1317 microversion: 2.1 time: 0.193270 Dec 24 10:45:37.581650 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 54/113] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:45:37 2021] GET /compute/v2.1/servers/b18ab8db-0c1f-4343-ae07-953fc820b211 => generated 1317 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:45:37.961939 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-62dae3ea-7657-4903-b0f3-3aeedca691d0 tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:45:37.962622 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-62dae3ea-7657-4903-b0f3-3aeedca691d0 tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] [instance: f77538c5-1e85-4d4f-b6cb-1c003149fac1] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:45:37.968687 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-62dae3ea-7657-4903-b0f3-3aeedca691d0 tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:45:37.969289 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-62dae3ea-7657-4903-b0f3-3aeedca691d0 tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:45:37.970279 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-62dae3ea-7657-4903-b0f3-3aeedca691d0 tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:45:37.970869 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-62dae3ea-7657-4903-b0f3-3aeedca691d0 tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:45:38.105361 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-62dae3ea-7657-4903-b0f3-3aeedca691d0 tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75a06733f5d4b7e8044fe6a9914a5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52385c4779dd49e7b3f0d9e56a8d2d26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:45:38.112662 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-62dae3ea-7657-4903-b0f3-3aeedca691d0 tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] 10.222.0.30 "GET /compute/v2.1/servers/f77538c5-1e85-4d4f-b6cb-1c003149fac1" status: 200 len: 1315 microversion: 2.1 time: 0.155687 Dec 24 10:45:38.113276 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 60/114] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:45:37 2021] GET /compute/v2.1/servers/f77538c5-1e85-4d4f-b6cb-1c003149fac1 => generated 1315 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:45:38.199817 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-3d65fd1a-fdc4-4129-924a-70461dd7eb0e tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:45:38.200504 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-3d65fd1a-fdc4-4129-924a-70461dd7eb0e tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] [instance: a99a6a98-4010-4f8e-a83f-fcc490f6ece0] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:45:38.206418 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-3d65fd1a-fdc4-4129-924a-70461dd7eb0e tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:45:38.207800 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-3d65fd1a-fdc4-4129-924a-70461dd7eb0e tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:45:38.207800 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-3d65fd1a-fdc4-4129-924a-70461dd7eb0e tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:45:38.208396 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-3d65fd1a-fdc4-4129-924a-70461dd7eb0e tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:45:38.368692 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-3d65fd1a-fdc4-4129-924a-70461dd7eb0e tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:45:38.377305 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-3d65fd1a-fdc4-4129-924a-70461dd7eb0e tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:45:38.379117 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-3d65fd1a-fdc4-4129-924a-70461dd7eb0e tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:45:38.381162 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-3d65fd1a-fdc4-4129-924a-70461dd7eb0e tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] 10.222.0.30 "GET /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0" status: 200 len: 1407 microversion: 2.20 time: 0.184446 Dec 24 10:45:38.382559 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 55/115] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Dec 24 10:45:38 2021] GET /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0 => generated 1407 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 10:45:38.396844 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-069b85eb-011a-4c0b-99e6-99c7855298e5 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:45:38.397697 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-069b85eb-011a-4c0b-99e6-99c7855298e5 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] [instance: c2c661f2-d3da-4357-a7a8-3f85fc94cc60] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:45:38.404371 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-069b85eb-011a-4c0b-99e6-99c7855298e5 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:45:38.404953 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-069b85eb-011a-4c0b-99e6-99c7855298e5 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:45:38.405798 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-069b85eb-011a-4c0b-99e6-99c7855298e5 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:45:38.406302 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-069b85eb-011a-4c0b-99e6-99c7855298e5 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:45:38.555570 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-069b85eb-011a-4c0b-99e6-99c7855298e5 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d627b760f74f48ac560e2ce2e74e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '378bb44ad89440e49f7e290a5d31004e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:45:38.563127 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-069b85eb-011a-4c0b-99e6-99c7855298e5 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] 10.222.0.30 "GET /compute/v2.1/servers/c2c661f2-d3da-4357-a7a8-3f85fc94cc60" status: 200 len: 1322 microversion: 2.1 time: 0.170171 Dec 24 10:45:38.563816 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 61/116] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:45:38 2021] GET /compute/v2.1/servers/c2c661f2-d3da-4357-a7a8-3f85fc94cc60 => generated 1322 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 24 10:45:38.589820 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-53bd3004-5a9a-494d-a57f-6c6e41443126 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:45:38.590424 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-53bd3004-5a9a-494d-a57f-6c6e41443126 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] [instance: b18ab8db-0c1f-4343-ae07-953fc820b211] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:45:38.596677 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-53bd3004-5a9a-494d-a57f-6c6e41443126 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:45:38.597153 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-53bd3004-5a9a-494d-a57f-6c6e41443126 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:45:38.597943 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-53bd3004-5a9a-494d-a57f-6c6e41443126 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:45:38.598372 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-53bd3004-5a9a-494d-a57f-6c6e41443126 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:45:38.755248 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-53bd3004-5a9a-494d-a57f-6c6e41443126 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ad5096717dc425c849dfe95ea55a6af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62d11172cdf4959a15ac1ffc5601aca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:45:38.762972 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-53bd3004-5a9a-494d-a57f-6c6e41443126 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] 10.222.0.30 "GET /compute/v2.1/servers/b18ab8db-0c1f-4343-ae07-953fc820b211" status: 200 len: 1317 microversion: 2.1 time: 0.176794 Dec 24 10:45:38.763540 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 56/117] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:45:38 2021] GET /compute/v2.1/servers/b18ab8db-0c1f-4343-ae07-953fc820b211 => generated 1317 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:45:39.131938 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-6fe58bd6-f6b1-4e87-b64a-4d1d894395bd tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:45:39.132528 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-6fe58bd6-f6b1-4e87-b64a-4d1d894395bd tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] [instance: f77538c5-1e85-4d4f-b6cb-1c003149fac1] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:45:39.139354 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-6fe58bd6-f6b1-4e87-b64a-4d1d894395bd tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:45:39.140033 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-6fe58bd6-f6b1-4e87-b64a-4d1d894395bd tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:45:39.140906 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-6fe58bd6-f6b1-4e87-b64a-4d1d894395bd tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:45:39.141340 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-6fe58bd6-f6b1-4e87-b64a-4d1d894395bd tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:45:39.290430 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-6fe58bd6-f6b1-4e87-b64a-4d1d894395bd tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75a06733f5d4b7e8044fe6a9914a5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52385c4779dd49e7b3f0d9e56a8d2d26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:45:39.297730 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-6fe58bd6-f6b1-4e87-b64a-4d1d894395bd tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] 10.222.0.30 "GET /compute/v2.1/servers/f77538c5-1e85-4d4f-b6cb-1c003149fac1" status: 200 len: 1315 microversion: 2.1 time: 0.170305 Dec 24 10:45:39.298328 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 62/118] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:45:39 2021] GET /compute/v2.1/servers/f77538c5-1e85-4d4f-b6cb-1c003149fac1 => generated 1315 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:45:39.399097 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-4e735827-ed6b-481e-b27c-f4a476c4dc00 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:45:39.399943 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-4e735827-ed6b-481e-b27c-f4a476c4dc00 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] [instance: a99a6a98-4010-4f8e-a83f-fcc490f6ece0] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:45:39.406561 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-4e735827-ed6b-481e-b27c-f4a476c4dc00 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:45:39.407003 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-4e735827-ed6b-481e-b27c-f4a476c4dc00 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:45:39.407772 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-4e735827-ed6b-481e-b27c-f4a476c4dc00 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:45:39.408197 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-4e735827-ed6b-481e-b27c-f4a476c4dc00 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:45:39.461094 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [req-8cfeee4f-13a3-49c7-8f82-25b6ecb2126a req-3c7dd7b6-94d0-4b2b-8399-febfbaa53ea2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c2c661f2-d3da-4357-a7a8-3f85fc94cc60", "name": "network-vif-plugged", "status": "completed", "tag": "11e42488-46c0-47e4-b7d6-51ddfdde57c9"}, {"server_uuid": "f77538c5-1e85-4d4f-b6cb-1c003149fac1", "name": "network-vif-plugged", "status": "completed", "tag": "194d1221-8d93-48d8-9ae0-aff4aac7c1b9"}, {"server_uuid": "b18ab8db-0c1f-4343-ae07-953fc820b211", "name": "network-vif-plugged", "status": "completed", "tag": "c73f6a9a-c9cb-49c0-9d7c-7793864fb03a"}]} {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:45:39.462982 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 10:45:39.462982 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: warnings.warn(msg) Dec 24 10:45:39.471024 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [req-8cfeee4f-13a3-49c7-8f82-25b6ecb2126a req-3c7dd7b6-94d0-4b2b-8399-febfbaa53ea2 service nova] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:45:39.471498 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [req-8cfeee4f-13a3-49c7-8f82-25b6ecb2126a req-3c7dd7b6-94d0-4b2b-8399-febfbaa53ea2 service nova] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:45:39.485611 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.compute.server_external_events [req-8cfeee4f-13a3-49c7-8f82-25b6ecb2126a req-3c7dd7b6-94d0-4b2b-8399-febfbaa53ea2 service nova] Creating event network-vif-plugged:11e42488-46c0-47e4-b7d6-51ddfdde57c9 for instance c2c661f2-d3da-4357-a7a8-3f85fc94cc60 on hv-cinder-81644 Dec 24 10:45:39.486114 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.compute.server_external_events [req-8cfeee4f-13a3-49c7-8f82-25b6ecb2126a req-3c7dd7b6-94d0-4b2b-8399-febfbaa53ea2 service nova] Creating event network-vif-plugged:194d1221-8d93-48d8-9ae0-aff4aac7c1b9 for instance f77538c5-1e85-4d4f-b6cb-1c003149fac1 on hv-cinder-81644 Dec 24 10:45:39.486639 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.compute.server_external_events [req-8cfeee4f-13a3-49c7-8f82-25b6ecb2126a req-3c7dd7b6-94d0-4b2b-8399-febfbaa53ea2 service nova] Creating event network-vif-plugged:c73f6a9a-c9cb-49c0-9d7c-7793864fb03a for instance b18ab8db-0c1f-4343-ae07-953fc820b211 on hv-cinder-81644 Dec 24 10:45:39.496063 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [req-8cfeee4f-13a3-49c7-8f82-25b6ecb2126a req-3c7dd7b6-94d0-4b2b-8399-febfbaa53ea2 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.039038 Dec 24 10:45:39.499976 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 63/119] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Dec 24 10:45:39 2021] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 10:45:39.547459 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-4e735827-ed6b-481e-b27c-f4a476c4dc00 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:45:39.555641 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-4e735827-ed6b-481e-b27c-f4a476c4dc00 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:45:39.559517 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-4e735827-ed6b-481e-b27c-f4a476c4dc00 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:45:39.559517 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-4e735827-ed6b-481e-b27c-f4a476c4dc00 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] 10.222.0.30 "GET /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0" status: 200 len: 1407 microversion: 2.20 time: 0.162873 Dec 24 10:45:39.559517 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 57/120] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Dec 24 10:45:39 2021] GET /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0 => generated 1407 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 10:45:39.579938 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-f715492c-25fc-4733-8b54-6f2b8931091c tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:45:39.582462 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-f715492c-25fc-4733-8b54-6f2b8931091c tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] [instance: c2c661f2-d3da-4357-a7a8-3f85fc94cc60] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:45:39.586995 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-f715492c-25fc-4733-8b54-6f2b8931091c tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:45:39.587469 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-f715492c-25fc-4733-8b54-6f2b8931091c tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:45:39.588309 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-f715492c-25fc-4733-8b54-6f2b8931091c tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:45:39.588754 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-f715492c-25fc-4733-8b54-6f2b8931091c tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:45:39.723043 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-f715492c-25fc-4733-8b54-6f2b8931091c tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d627b760f74f48ac560e2ce2e74e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '378bb44ad89440e49f7e290a5d31004e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:45:39.735611 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-f715492c-25fc-4733-8b54-6f2b8931091c tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] 10.222.0.30 "GET /compute/v2.1/servers/c2c661f2-d3da-4357-a7a8-3f85fc94cc60" status: 200 len: 1322 microversion: 2.1 time: 0.159303 Dec 24 10:45:39.735751 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 64/121] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:45:39 2021] GET /compute/v2.1/servers/c2c661f2-d3da-4357-a7a8-3f85fc94cc60 => generated 1322 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:45:39.779944 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-7f5a3518-1461-48d1-b5e6-71802201725a tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:45:39.780579 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-7f5a3518-1461-48d1-b5e6-71802201725a tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] [instance: b18ab8db-0c1f-4343-ae07-953fc820b211] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:45:39.788200 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-7f5a3518-1461-48d1-b5e6-71802201725a tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:45:39.788647 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-7f5a3518-1461-48d1-b5e6-71802201725a tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:45:39.789475 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-7f5a3518-1461-48d1-b5e6-71802201725a tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:45:39.790110 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-7f5a3518-1461-48d1-b5e6-71802201725a tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:45:39.959178 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-7f5a3518-1461-48d1-b5e6-71802201725a tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ad5096717dc425c849dfe95ea55a6af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62d11172cdf4959a15ac1ffc5601aca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:45:39.968143 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-7f5a3518-1461-48d1-b5e6-71802201725a tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] 10.222.0.30 "GET /compute/v2.1/servers/b18ab8db-0c1f-4343-ae07-953fc820b211" status: 200 len: 1317 microversion: 2.1 time: 0.191917 Dec 24 10:45:39.972844 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 58/122] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:45:39 2021] GET /compute/v2.1/servers/b18ab8db-0c1f-4343-ae07-953fc820b211 => generated 1317 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:45:40.314718 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-79665aed-6767-4e53-8a90-352b69c7ec27 tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:45:40.315320 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-79665aed-6767-4e53-8a90-352b69c7ec27 tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] [instance: f77538c5-1e85-4d4f-b6cb-1c003149fac1] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:45:40.321258 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-79665aed-6767-4e53-8a90-352b69c7ec27 tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:45:40.321643 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-79665aed-6767-4e53-8a90-352b69c7ec27 tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:45:40.322412 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-79665aed-6767-4e53-8a90-352b69c7ec27 tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:45:40.322842 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-79665aed-6767-4e53-8a90-352b69c7ec27 tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:45:40.453183 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-79665aed-6767-4e53-8a90-352b69c7ec27 tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75a06733f5d4b7e8044fe6a9914a5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52385c4779dd49e7b3f0d9e56a8d2d26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:45:40.460948 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-79665aed-6767-4e53-8a90-352b69c7ec27 tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] 10.222.0.30 "GET /compute/v2.1/servers/f77538c5-1e85-4d4f-b6cb-1c003149fac1" status: 200 len: 1315 microversion: 2.1 time: 0.149806 Dec 24 10:45:40.461511 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 65/123] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:45:40 2021] GET /compute/v2.1/servers/f77538c5-1e85-4d4f-b6cb-1c003149fac1 => generated 1315 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:45:40.575123 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-ef70453e-7fdc-4079-803f-fac35f8525cd tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:45:40.575689 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-ef70453e-7fdc-4079-803f-fac35f8525cd tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] [instance: a99a6a98-4010-4f8e-a83f-fcc490f6ece0] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:45:40.581564 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-ef70453e-7fdc-4079-803f-fac35f8525cd tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:45:40.582078 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-ef70453e-7fdc-4079-803f-fac35f8525cd tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:45:40.582829 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-ef70453e-7fdc-4079-803f-fac35f8525cd tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:45:40.583256 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-ef70453e-7fdc-4079-803f-fac35f8525cd tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:45:40.714983 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-ef70453e-7fdc-4079-803f-fac35f8525cd tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:45:40.722810 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-ef70453e-7fdc-4079-803f-fac35f8525cd tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:45:40.724313 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-ef70453e-7fdc-4079-803f-fac35f8525cd tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:45:40.725467 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-ef70453e-7fdc-4079-803f-fac35f8525cd tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] 10.222.0.30 "GET /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0" status: 200 len: 1407 microversion: 2.20 time: 0.154068 Dec 24 10:45:40.726026 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 59/124] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Dec 24 10:45:40 2021] GET /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0 => generated 1407 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 24 10:45:40.751076 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-191c14f1-c789-4cc1-b850-b8fa1d5832e3 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:45:40.751768 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-191c14f1-c789-4cc1-b850-b8fa1d5832e3 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] [instance: c2c661f2-d3da-4357-a7a8-3f85fc94cc60] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:45:40.758327 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-191c14f1-c789-4cc1-b850-b8fa1d5832e3 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:45:40.759654 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-191c14f1-c789-4cc1-b850-b8fa1d5832e3 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:45:40.760578 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-191c14f1-c789-4cc1-b850-b8fa1d5832e3 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:45:40.761160 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-191c14f1-c789-4cc1-b850-b8fa1d5832e3 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:45:40.943990 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-191c14f1-c789-4cc1-b850-b8fa1d5832e3 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d627b760f74f48ac560e2ce2e74e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '378bb44ad89440e49f7e290a5d31004e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:45:40.951208 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-191c14f1-c789-4cc1-b850-b8fa1d5832e3 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] 10.222.0.30 "GET /compute/v2.1/servers/c2c661f2-d3da-4357-a7a8-3f85fc94cc60" status: 200 len: 1322 microversion: 2.1 time: 0.203732 Dec 24 10:45:40.951862 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 66/125] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:45:40 2021] GET /compute/v2.1/servers/c2c661f2-d3da-4357-a7a8-3f85fc94cc60 => generated 1322 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:45:40.985857 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-a6c48a56-c38c-47ad-a259-c190a6cf9507 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:45:40.986466 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-a6c48a56-c38c-47ad-a259-c190a6cf9507 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] [instance: b18ab8db-0c1f-4343-ae07-953fc820b211] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:45:40.992861 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-a6c48a56-c38c-47ad-a259-c190a6cf9507 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:45:40.993314 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-a6c48a56-c38c-47ad-a259-c190a6cf9507 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:45:40.994072 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-a6c48a56-c38c-47ad-a259-c190a6cf9507 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:45:40.994492 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-a6c48a56-c38c-47ad-a259-c190a6cf9507 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:45:41.124639 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-a6c48a56-c38c-47ad-a259-c190a6cf9507 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ad5096717dc425c849dfe95ea55a6af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62d11172cdf4959a15ac1ffc5601aca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:45:41.133702 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-a6c48a56-c38c-47ad-a259-c190a6cf9507 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] 10.222.0.30 "GET /compute/v2.1/servers/b18ab8db-0c1f-4343-ae07-953fc820b211" status: 200 len: 1317 microversion: 2.1 time: 0.152342 Dec 24 10:45:41.134361 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 60/126] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:45:40 2021] GET /compute/v2.1/servers/b18ab8db-0c1f-4343-ae07-953fc820b211 => generated 1317 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:45:41.478151 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-cc658c57-82c7-41ce-8d68-5d762a0b8c35 tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:45:41.478743 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-cc658c57-82c7-41ce-8d68-5d762a0b8c35 tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] [instance: f77538c5-1e85-4d4f-b6cb-1c003149fac1] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:45:41.484550 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-cc658c57-82c7-41ce-8d68-5d762a0b8c35 tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:45:41.485085 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-cc658c57-82c7-41ce-8d68-5d762a0b8c35 tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:45:41.486014 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-cc658c57-82c7-41ce-8d68-5d762a0b8c35 tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:45:41.486434 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-cc658c57-82c7-41ce-8d68-5d762a0b8c35 tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:45:41.620250 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-cc658c57-82c7-41ce-8d68-5d762a0b8c35 tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75a06733f5d4b7e8044fe6a9914a5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52385c4779dd49e7b3f0d9e56a8d2d26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:45:41.627555 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-cc658c57-82c7-41ce-8d68-5d762a0b8c35 tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] 10.222.0.30 "GET /compute/v2.1/servers/f77538c5-1e85-4d4f-b6cb-1c003149fac1" status: 200 len: 1315 microversion: 2.1 time: 0.153586 Dec 24 10:45:41.628131 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 67/127] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:45:41 2021] GET /compute/v2.1/servers/f77538c5-1e85-4d4f-b6cb-1c003149fac1 => generated 1315 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:45:41.747624 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-826d5e9f-3c94-4c4d-91d3-5370a4980f74 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:45:41.747624 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-826d5e9f-3c94-4c4d-91d3-5370a4980f74 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] [instance: a99a6a98-4010-4f8e-a83f-fcc490f6ece0] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:45:41.750001 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-826d5e9f-3c94-4c4d-91d3-5370a4980f74 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:45:41.750444 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-826d5e9f-3c94-4c4d-91d3-5370a4980f74 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:45:41.751230 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-826d5e9f-3c94-4c4d-91d3-5370a4980f74 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:45:41.751658 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-826d5e9f-3c94-4c4d-91d3-5370a4980f74 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:45:41.887643 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-826d5e9f-3c94-4c4d-91d3-5370a4980f74 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:45:41.895769 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-826d5e9f-3c94-4c4d-91d3-5370a4980f74 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:45:41.898019 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-826d5e9f-3c94-4c4d-91d3-5370a4980f74 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:45:41.899251 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-826d5e9f-3c94-4c4d-91d3-5370a4980f74 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] 10.222.0.30 "GET /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0" status: 200 len: 1407 microversion: 2.20 time: 0.161075 Dec 24 10:45:41.910015 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 61/128] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Dec 24 10:45:41 2021] GET /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0 => generated 1407 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 10:45:41.967777 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-dd967831-3b0f-4fd8-90d9-e1f5a9bc0306 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:45:41.968415 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-dd967831-3b0f-4fd8-90d9-e1f5a9bc0306 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] [instance: c2c661f2-d3da-4357-a7a8-3f85fc94cc60] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:45:41.974383 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-dd967831-3b0f-4fd8-90d9-e1f5a9bc0306 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:45:41.974878 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-dd967831-3b0f-4fd8-90d9-e1f5a9bc0306 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:45:41.975674 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-dd967831-3b0f-4fd8-90d9-e1f5a9bc0306 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:45:41.976127 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-dd967831-3b0f-4fd8-90d9-e1f5a9bc0306 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:45:42.112934 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-dd967831-3b0f-4fd8-90d9-e1f5a9bc0306 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d627b760f74f48ac560e2ce2e74e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '378bb44ad89440e49f7e290a5d31004e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:45:42.113272 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-dd967831-3b0f-4fd8-90d9-e1f5a9bc0306 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] 10.222.0.30 "GET /compute/v2.1/servers/c2c661f2-d3da-4357-a7a8-3f85fc94cc60" status: 200 len: 1322 microversion: 2.1 time: 0.149292 Dec 24 10:45:42.113838 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 68/129] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:45:41 2021] GET /compute/v2.1/servers/c2c661f2-d3da-4357-a7a8-3f85fc94cc60 => generated 1322 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:45:42.150241 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-8b659760-d6e1-4106-a4ee-39ef40c54cf4 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:45:42.150840 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-8b659760-d6e1-4106-a4ee-39ef40c54cf4 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] [instance: b18ab8db-0c1f-4343-ae07-953fc820b211] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:45:42.156593 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-8b659760-d6e1-4106-a4ee-39ef40c54cf4 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:45:42.157147 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-8b659760-d6e1-4106-a4ee-39ef40c54cf4 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:45:42.157918 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-8b659760-d6e1-4106-a4ee-39ef40c54cf4 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:45:42.158351 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-8b659760-d6e1-4106-a4ee-39ef40c54cf4 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:45:42.307640 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-8b659760-d6e1-4106-a4ee-39ef40c54cf4 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ad5096717dc425c849dfe95ea55a6af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62d11172cdf4959a15ac1ffc5601aca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:45:42.315213 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-8b659760-d6e1-4106-a4ee-39ef40c54cf4 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] 10.222.0.30 "GET /compute/v2.1/servers/b18ab8db-0c1f-4343-ae07-953fc820b211" status: 200 len: 1317 microversion: 2.1 time: 0.169329 Dec 24 10:45:42.315838 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 62/130] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:45:42 2021] GET /compute/v2.1/servers/b18ab8db-0c1f-4343-ae07-953fc820b211 => generated 1317 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:45:42.644647 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-7d15cf76-e684-41ae-8de8-caf3baed73f1 tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:45:42.645341 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-7d15cf76-e684-41ae-8de8-caf3baed73f1 tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] [instance: f77538c5-1e85-4d4f-b6cb-1c003149fac1] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:45:42.651982 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-7d15cf76-e684-41ae-8de8-caf3baed73f1 tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:45:42.652433 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-7d15cf76-e684-41ae-8de8-caf3baed73f1 tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:45:42.653236 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-7d15cf76-e684-41ae-8de8-caf3baed73f1 tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:45:42.653675 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-7d15cf76-e684-41ae-8de8-caf3baed73f1 tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:45:42.800094 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-7d15cf76-e684-41ae-8de8-caf3baed73f1 tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75a06733f5d4b7e8044fe6a9914a5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52385c4779dd49e7b3f0d9e56a8d2d26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:45:42.808352 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-7d15cf76-e684-41ae-8de8-caf3baed73f1 tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] 10.222.0.30 "GET /compute/v2.1/servers/f77538c5-1e85-4d4f-b6cb-1c003149fac1" status: 200 len: 1315 microversion: 2.1 time: 0.167160 Dec 24 10:45:42.809109 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 69/131] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:45:42 2021] GET /compute/v2.1/servers/f77538c5-1e85-4d4f-b6cb-1c003149fac1 => generated 1315 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:45:42.920543 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-b333ad0c-2af0-410d-b437-8734fdc18a41 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:45:42.921188 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-b333ad0c-2af0-410d-b437-8734fdc18a41 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] [instance: a99a6a98-4010-4f8e-a83f-fcc490f6ece0] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:45:42.927034 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-b333ad0c-2af0-410d-b437-8734fdc18a41 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:45:42.927479 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-b333ad0c-2af0-410d-b437-8734fdc18a41 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:45:42.928280 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-b333ad0c-2af0-410d-b437-8734fdc18a41 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:45:42.928709 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-b333ad0c-2af0-410d-b437-8734fdc18a41 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:45:43.129524 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-a270bed7-2a7f-43ed-b99d-8ee0edc4b79d tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:45:43.130141 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-a270bed7-2a7f-43ed-b99d-8ee0edc4b79d tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] [instance: c2c661f2-d3da-4357-a7a8-3f85fc94cc60] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:45:43.137369 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-a270bed7-2a7f-43ed-b99d-8ee0edc4b79d tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:45:43.138154 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-a270bed7-2a7f-43ed-b99d-8ee0edc4b79d tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:45:43.141616 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-a270bed7-2a7f-43ed-b99d-8ee0edc4b79d tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:45:43.141616 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-a270bed7-2a7f-43ed-b99d-8ee0edc4b79d tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:45:43.244582 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-b333ad0c-2af0-410d-b437-8734fdc18a41 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:45:43.252237 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-b333ad0c-2af0-410d-b437-8734fdc18a41 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:45:43.253735 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-b333ad0c-2af0-410d-b437-8734fdc18a41 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:45:43.255014 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-b333ad0c-2af0-410d-b437-8734fdc18a41 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] 10.222.0.30 "GET /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0" status: 200 len: 1407 microversion: 2.20 time: 0.338188 Dec 24 10:45:43.256073 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 63/132] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Dec 24 10:45:42 2021] GET /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0 => generated 1407 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 10:45:43.331354 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-57dc6c11-cc24-4ec6-9e4f-f023eeb25ccb tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:45:43.331890 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-57dc6c11-cc24-4ec6-9e4f-f023eeb25ccb tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] [instance: b18ab8db-0c1f-4343-ae07-953fc820b211] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:45:43.337782 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-a270bed7-2a7f-43ed-b99d-8ee0edc4b79d tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d627b760f74f48ac560e2ce2e74e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '378bb44ad89440e49f7e290a5d31004e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:45:43.341844 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-57dc6c11-cc24-4ec6-9e4f-f023eeb25ccb tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:45:43.341844 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-57dc6c11-cc24-4ec6-9e4f-f023eeb25ccb tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:45:43.341844 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-57dc6c11-cc24-4ec6-9e4f-f023eeb25ccb tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:45:43.341844 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-57dc6c11-cc24-4ec6-9e4f-f023eeb25ccb tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:45:43.347585 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-a270bed7-2a7f-43ed-b99d-8ee0edc4b79d tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] 10.222.0.30 "GET /compute/v2.1/servers/c2c661f2-d3da-4357-a7a8-3f85fc94cc60" status: 200 len: 1322 microversion: 2.1 time: 0.221730 Dec 24 10:45:43.348338 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 70/133] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:45:43 2021] GET /compute/v2.1/servers/c2c661f2-d3da-4357-a7a8-3f85fc94cc60 => generated 1322 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:45:43.480100 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-57dc6c11-cc24-4ec6-9e4f-f023eeb25ccb tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ad5096717dc425c849dfe95ea55a6af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62d11172cdf4959a15ac1ffc5601aca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:45:43.487373 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-57dc6c11-cc24-4ec6-9e4f-f023eeb25ccb tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] 10.222.0.30 "GET /compute/v2.1/servers/b18ab8db-0c1f-4343-ae07-953fc820b211" status: 200 len: 1317 microversion: 2.1 time: 0.159640 Dec 24 10:45:43.487941 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 64/134] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:45:43 2021] GET /compute/v2.1/servers/b18ab8db-0c1f-4343-ae07-953fc820b211 => generated 1317 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:45:43.824974 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-da7777c4-dd2f-4a53-9fc4-4350e14ed9af tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:45:43.825617 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-da7777c4-dd2f-4a53-9fc4-4350e14ed9af tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] [instance: f77538c5-1e85-4d4f-b6cb-1c003149fac1] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:45:43.831987 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-da7777c4-dd2f-4a53-9fc4-4350e14ed9af tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:45:43.832656 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-da7777c4-dd2f-4a53-9fc4-4350e14ed9af tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:45:43.835096 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-da7777c4-dd2f-4a53-9fc4-4350e14ed9af tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:45:43.835096 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-da7777c4-dd2f-4a53-9fc4-4350e14ed9af tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:45:43.984972 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-da7777c4-dd2f-4a53-9fc4-4350e14ed9af tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75a06733f5d4b7e8044fe6a9914a5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52385c4779dd49e7b3f0d9e56a8d2d26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:45:43.986153 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-da7777c4-dd2f-4a53-9fc4-4350e14ed9af tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] 10.222.0.30 "GET /compute/v2.1/servers/f77538c5-1e85-4d4f-b6cb-1c003149fac1" status: 200 len: 1315 microversion: 2.1 time: 0.164865 Dec 24 10:45:43.986949 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 71/135] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:45:43 2021] GET /compute/v2.1/servers/f77538c5-1e85-4d4f-b6cb-1c003149fac1 => generated 1315 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:45:44.273599 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-c3e0ab65-81b4-46e5-af24-7a2425dae8f0 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:45:44.274998 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-c3e0ab65-81b4-46e5-af24-7a2425dae8f0 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] [instance: a99a6a98-4010-4f8e-a83f-fcc490f6ece0] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:45:44.281662 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-c3e0ab65-81b4-46e5-af24-7a2425dae8f0 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:45:44.282139 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-c3e0ab65-81b4-46e5-af24-7a2425dae8f0 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:45:44.282943 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-c3e0ab65-81b4-46e5-af24-7a2425dae8f0 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:45:44.283396 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-c3e0ab65-81b4-46e5-af24-7a2425dae8f0 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:45:44.365831 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-06b6defb-6ee2-4ea0-a04d-800db5f191a3 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:45:44.366438 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-06b6defb-6ee2-4ea0-a04d-800db5f191a3 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] [instance: c2c661f2-d3da-4357-a7a8-3f85fc94cc60] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:45:44.372950 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-06b6defb-6ee2-4ea0-a04d-800db5f191a3 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:45:44.373431 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-06b6defb-6ee2-4ea0-a04d-800db5f191a3 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:45:44.374212 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-06b6defb-6ee2-4ea0-a04d-800db5f191a3 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:45:44.374639 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-06b6defb-6ee2-4ea0-a04d-800db5f191a3 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:45:44.427612 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-c3e0ab65-81b4-46e5-af24-7a2425dae8f0 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:45:44.435332 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-c3e0ab65-81b4-46e5-af24-7a2425dae8f0 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:45:44.436903 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-c3e0ab65-81b4-46e5-af24-7a2425dae8f0 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:45:44.437959 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-c3e0ab65-81b4-46e5-af24-7a2425dae8f0 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] 10.222.0.30 "GET /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0" status: 200 len: 1407 microversion: 2.20 time: 0.168583 Dec 24 10:45:44.438509 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 65/136] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Dec 24 10:45:44 2021] GET /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0 => generated 1407 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 24 10:45:44.504456 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-a635444d-8f5f-40c4-ac17-87c6e11e06fd tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:45:44.505667 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-a635444d-8f5f-40c4-ac17-87c6e11e06fd tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] [instance: b18ab8db-0c1f-4343-ae07-953fc820b211] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:45:44.510921 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-06b6defb-6ee2-4ea0-a04d-800db5f191a3 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d627b760f74f48ac560e2ce2e74e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '378bb44ad89440e49f7e290a5d31004e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:45:44.512110 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-a635444d-8f5f-40c4-ac17-87c6e11e06fd tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:45:44.512565 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-a635444d-8f5f-40c4-ac17-87c6e11e06fd tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:45:44.513654 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-a635444d-8f5f-40c4-ac17-87c6e11e06fd tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:45:44.514080 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-a635444d-8f5f-40c4-ac17-87c6e11e06fd tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:45:44.519097 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-06b6defb-6ee2-4ea0-a04d-800db5f191a3 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] 10.222.0.30 "GET /compute/v2.1/servers/c2c661f2-d3da-4357-a7a8-3f85fc94cc60" status: 200 len: 1322 microversion: 2.1 time: 0.157386 Dec 24 10:45:44.519819 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 72/137] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:45:44 2021] GET /compute/v2.1/servers/c2c661f2-d3da-4357-a7a8-3f85fc94cc60 => generated 1322 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 24 10:45:44.656680 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-a635444d-8f5f-40c4-ac17-87c6e11e06fd tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ad5096717dc425c849dfe95ea55a6af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62d11172cdf4959a15ac1ffc5601aca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:45:44.665588 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-a635444d-8f5f-40c4-ac17-87c6e11e06fd tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] 10.222.0.30 "GET /compute/v2.1/servers/b18ab8db-0c1f-4343-ae07-953fc820b211" status: 200 len: 1317 microversion: 2.1 time: 0.164907 Dec 24 10:45:44.666959 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 66/138] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:45:44 2021] GET /compute/v2.1/servers/b18ab8db-0c1f-4343-ae07-953fc820b211 => generated 1317 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 24 10:45:45.002656 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-868eea3f-8d29-44ea-a4da-b09a072f1855 tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:45:45.003258 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-868eea3f-8d29-44ea-a4da-b09a072f1855 tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] [instance: f77538c5-1e85-4d4f-b6cb-1c003149fac1] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:45:45.010024 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-868eea3f-8d29-44ea-a4da-b09a072f1855 tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:45:45.010532 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-868eea3f-8d29-44ea-a4da-b09a072f1855 tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:45:45.011314 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-868eea3f-8d29-44ea-a4da-b09a072f1855 tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:45:45.011746 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-868eea3f-8d29-44ea-a4da-b09a072f1855 tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:45:45.154414 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-868eea3f-8d29-44ea-a4da-b09a072f1855 tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75a06733f5d4b7e8044fe6a9914a5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52385c4779dd49e7b3f0d9e56a8d2d26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:45:45.162304 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-868eea3f-8d29-44ea-a4da-b09a072f1855 tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] 10.222.0.30 "GET /compute/v2.1/servers/f77538c5-1e85-4d4f-b6cb-1c003149fac1" status: 200 len: 1315 microversion: 2.1 time: 0.162672 Dec 24 10:45:45.166031 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 73/139] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:45:44 2021] GET /compute/v2.1/servers/f77538c5-1e85-4d4f-b6cb-1c003149fac1 => generated 1315 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:45:45.197201 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [req-6abf3d93-ec94-442c-8dc2-cfd0d0465eca req-8f90b7ab-4924-410a-9dba-a9778ed23090 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a99a6a98-4010-4f8e-a83f-fcc490f6ece0", "name": "network-vif-plugged", "status": "completed", "tag": "e50dfc57-62cb-4d13-9e17-f48edcdb1dcc"}]} {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:45:45.199339 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 10:45:45.199339 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: warnings.warn(msg) Dec 24 10:45:45.207018 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [req-6abf3d93-ec94-442c-8dc2-cfd0d0465eca req-8f90b7ab-4924-410a-9dba-a9778ed23090 service nova] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:45:45.207459 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [req-6abf3d93-ec94-442c-8dc2-cfd0d0465eca req-8f90b7ab-4924-410a-9dba-a9778ed23090 service nova] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:45:45.218423 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.compute.server_external_events [req-6abf3d93-ec94-442c-8dc2-cfd0d0465eca req-8f90b7ab-4924-410a-9dba-a9778ed23090 service nova] Creating event network-vif-plugged:e50dfc57-62cb-4d13-9e17-f48edcdb1dcc for instance a99a6a98-4010-4f8e-a83f-fcc490f6ece0 on hv-cinder-81644 Dec 24 10:45:45.223466 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [req-6abf3d93-ec94-442c-8dc2-cfd0d0465eca req-8f90b7ab-4924-410a-9dba-a9778ed23090 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031715 Dec 24 10:45:45.224947 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 67/140] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Dec 24 10:45:45 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 24 10:45:45.455394 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-1594f525-cb5a-4fb6-bb60-5111bef65ddb tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:45:45.459300 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-1594f525-cb5a-4fb6-bb60-5111bef65ddb tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] [instance: a99a6a98-4010-4f8e-a83f-fcc490f6ece0] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:45:45.466226 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-1594f525-cb5a-4fb6-bb60-5111bef65ddb tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:45:45.466682 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-1594f525-cb5a-4fb6-bb60-5111bef65ddb tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:45:45.467605 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-1594f525-cb5a-4fb6-bb60-5111bef65ddb tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:45:45.468052 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-1594f525-cb5a-4fb6-bb60-5111bef65ddb tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:45:45.536048 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-95d113ba-d02b-490d-83b6-f6ef6ce2e54a tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:45:45.536741 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-95d113ba-d02b-490d-83b6-f6ef6ce2e54a tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] [instance: c2c661f2-d3da-4357-a7a8-3f85fc94cc60] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:45:45.542823 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-95d113ba-d02b-490d-83b6-f6ef6ce2e54a tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:45:45.543267 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-95d113ba-d02b-490d-83b6-f6ef6ce2e54a tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:45:45.544043 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-95d113ba-d02b-490d-83b6-f6ef6ce2e54a tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:45:45.544472 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-95d113ba-d02b-490d-83b6-f6ef6ce2e54a tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:45:45.598873 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-1594f525-cb5a-4fb6-bb60-5111bef65ddb tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:45:45.609873 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-1594f525-cb5a-4fb6-bb60-5111bef65ddb tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:45:45.611529 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-1594f525-cb5a-4fb6-bb60-5111bef65ddb tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:45:45.612719 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-1594f525-cb5a-4fb6-bb60-5111bef65ddb tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] 10.222.0.30 "GET /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0" status: 200 len: 1407 microversion: 2.20 time: 0.161252 Dec 24 10:45:45.613394 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 74/141] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Dec 24 10:45:45 2021] GET /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0 => generated 1407 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 10:45:45.681511 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-0cd228ba-c6d2-466b-a025-01d9ab61f2d0 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:45:45.682389 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-0cd228ba-c6d2-466b-a025-01d9ab61f2d0 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] [instance: b18ab8db-0c1f-4343-ae07-953fc820b211] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:45:45.688633 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-0cd228ba-c6d2-466b-a025-01d9ab61f2d0 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:45:45.689105 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-0cd228ba-c6d2-466b-a025-01d9ab61f2d0 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:45:45.690044 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-0cd228ba-c6d2-466b-a025-01d9ab61f2d0 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:45:45.690623 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-0cd228ba-c6d2-466b-a025-01d9ab61f2d0 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:45:45.714704 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-95d113ba-d02b-490d-83b6-f6ef6ce2e54a tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d627b760f74f48ac560e2ce2e74e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '378bb44ad89440e49f7e290a5d31004e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:45:45.723766 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-95d113ba-d02b-490d-83b6-f6ef6ce2e54a tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] 10.222.0.30 "GET /compute/v2.1/servers/c2c661f2-d3da-4357-a7a8-3f85fc94cc60" status: 200 len: 1322 microversion: 2.1 time: 0.191643 Dec 24 10:45:45.725614 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 68/142] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:45:45 2021] GET /compute/v2.1/servers/c2c661f2-d3da-4357-a7a8-3f85fc94cc60 => generated 1322 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 24 10:45:45.859975 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-0cd228ba-c6d2-466b-a025-01d9ab61f2d0 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ad5096717dc425c849dfe95ea55a6af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62d11172cdf4959a15ac1ffc5601aca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:45:45.868390 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-0cd228ba-c6d2-466b-a025-01d9ab61f2d0 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] 10.222.0.30 "GET /compute/v2.1/servers/b18ab8db-0c1f-4343-ae07-953fc820b211" status: 200 len: 1317 microversion: 2.1 time: 0.190387 Dec 24 10:45:45.869374 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 75/143] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:45:45 2021] GET /compute/v2.1/servers/b18ab8db-0c1f-4343-ae07-953fc820b211 => generated 1317 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 24 10:45:46.179959 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-b7c076a7-6f9b-4726-b395-cad5b44d1ebc tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:45:46.180562 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-b7c076a7-6f9b-4726-b395-cad5b44d1ebc tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] [instance: f77538c5-1e85-4d4f-b6cb-1c003149fac1] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:45:46.186412 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-b7c076a7-6f9b-4726-b395-cad5b44d1ebc tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:45:46.186846 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-b7c076a7-6f9b-4726-b395-cad5b44d1ebc tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:45:46.187695 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-b7c076a7-6f9b-4726-b395-cad5b44d1ebc tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:45:46.188118 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-b7c076a7-6f9b-4726-b395-cad5b44d1ebc tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:45:46.337150 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-b7c076a7-6f9b-4726-b395-cad5b44d1ebc tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75a06733f5d4b7e8044fe6a9914a5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52385c4779dd49e7b3f0d9e56a8d2d26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:45:46.346662 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-b7c076a7-6f9b-4726-b395-cad5b44d1ebc tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] 10.222.0.30 "GET /compute/v2.1/servers/f77538c5-1e85-4d4f-b6cb-1c003149fac1" status: 200 len: 1315 microversion: 2.1 time: 0.170987 Dec 24 10:45:46.347230 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 69/144] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:45:46 2021] GET /compute/v2.1/servers/f77538c5-1e85-4d4f-b6cb-1c003149fac1 => generated 1315 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:45:46.629810 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-12ee22e3-3d70-42fa-b5cd-264ceeae33d4 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:45:46.630460 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-12ee22e3-3d70-42fa-b5cd-264ceeae33d4 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] [instance: a99a6a98-4010-4f8e-a83f-fcc490f6ece0] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:45:46.643827 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-12ee22e3-3d70-42fa-b5cd-264ceeae33d4 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:45:46.644327 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-12ee22e3-3d70-42fa-b5cd-264ceeae33d4 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:45:46.645201 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-12ee22e3-3d70-42fa-b5cd-264ceeae33d4 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:45:46.645599 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-12ee22e3-3d70-42fa-b5cd-264ceeae33d4 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:45:46.741287 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-baf08482-908b-49ca-9bef-ab9660af9119 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:45:46.748896 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-baf08482-908b-49ca-9bef-ab9660af9119 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] [instance: c2c661f2-d3da-4357-a7a8-3f85fc94cc60] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:45:46.761723 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-baf08482-908b-49ca-9bef-ab9660af9119 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:45:46.761723 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-baf08482-908b-49ca-9bef-ab9660af9119 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:45:46.761723 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-baf08482-908b-49ca-9bef-ab9660af9119 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:45:46.761723 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-baf08482-908b-49ca-9bef-ab9660af9119 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:45:46.823326 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-12ee22e3-3d70-42fa-b5cd-264ceeae33d4 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:45:46.847883 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-12ee22e3-3d70-42fa-b5cd-264ceeae33d4 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:45:46.850079 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-12ee22e3-3d70-42fa-b5cd-264ceeae33d4 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:45:46.851433 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-12ee22e3-3d70-42fa-b5cd-264ceeae33d4 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] 10.222.0.30 "GET /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0" status: 200 len: 1407 microversion: 2.20 time: 0.225471 Dec 24 10:45:46.852213 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 76/145] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Dec 24 10:45:46 2021] GET /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0 => generated 1407 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 10:45:46.885416 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-4fe34f00-9f45-4ddc-afa2-0573cf50e959 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:45:46.886254 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-4fe34f00-9f45-4ddc-afa2-0573cf50e959 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] [instance: b18ab8db-0c1f-4343-ae07-953fc820b211] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:45:46.902326 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-4fe34f00-9f45-4ddc-afa2-0573cf50e959 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:45:46.902894 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-4fe34f00-9f45-4ddc-afa2-0573cf50e959 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:45:46.903782 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-4fe34f00-9f45-4ddc-afa2-0573cf50e959 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:45:46.904513 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-4fe34f00-9f45-4ddc-afa2-0573cf50e959 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:45:46.951659 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-baf08482-908b-49ca-9bef-ab9660af9119 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d627b760f74f48ac560e2ce2e74e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '378bb44ad89440e49f7e290a5d31004e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:45:46.959001 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-baf08482-908b-49ca-9bef-ab9660af9119 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] 10.222.0.30 "GET /compute/v2.1/servers/c2c661f2-d3da-4357-a7a8-3f85fc94cc60" status: 200 len: 1322 microversion: 2.1 time: 0.221625 Dec 24 10:45:46.960125 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 70/146] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:45:46 2021] GET /compute/v2.1/servers/c2c661f2-d3da-4357-a7a8-3f85fc94cc60 => generated 1322 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 24 10:45:47.056129 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-4fe34f00-9f45-4ddc-afa2-0573cf50e959 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ad5096717dc425c849dfe95ea55a6af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62d11172cdf4959a15ac1ffc5601aca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:45:47.064111 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-4fe34f00-9f45-4ddc-afa2-0573cf50e959 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] 10.222.0.30 "GET /compute/v2.1/servers/b18ab8db-0c1f-4343-ae07-953fc820b211" status: 200 len: 1317 microversion: 2.1 time: 0.182292 Dec 24 10:45:47.065078 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 77/147] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:45:46 2021] GET /compute/v2.1/servers/b18ab8db-0c1f-4343-ae07-953fc820b211 => generated 1317 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:45:47.362921 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-f23c1de9-dcc2-4fc3-bb22-0ef8b1fa88e5 tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:45:47.363527 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-f23c1de9-dcc2-4fc3-bb22-0ef8b1fa88e5 tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] [instance: f77538c5-1e85-4d4f-b6cb-1c003149fac1] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:45:47.370000 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-f23c1de9-dcc2-4fc3-bb22-0ef8b1fa88e5 tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:45:47.370363 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-f23c1de9-dcc2-4fc3-bb22-0ef8b1fa88e5 tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:45:47.371134 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-f23c1de9-dcc2-4fc3-bb22-0ef8b1fa88e5 tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:45:47.371565 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-f23c1de9-dcc2-4fc3-bb22-0ef8b1fa88e5 tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:45:47.509099 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-f23c1de9-dcc2-4fc3-bb22-0ef8b1fa88e5 tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75a06733f5d4b7e8044fe6a9914a5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52385c4779dd49e7b3f0d9e56a8d2d26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:45:47.516630 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-f23c1de9-dcc2-4fc3-bb22-0ef8b1fa88e5 tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] 10.222.0.30 "GET /compute/v2.1/servers/f77538c5-1e85-4d4f-b6cb-1c003149fac1" status: 200 len: 1502 microversion: 2.1 time: 0.157384 Dec 24 10:45:47.517253 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 71/148] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:45:47 2021] GET /compute/v2.1/servers/f77538c5-1e85-4d4f-b6cb-1c003149fac1 => generated 1502 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:45:47.869548 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-8ccfe414-e42f-4f19-a2c8-b65d78ef7cb0 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:45:47.870152 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-8ccfe414-e42f-4f19-a2c8-b65d78ef7cb0 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] [instance: a99a6a98-4010-4f8e-a83f-fcc490f6ece0] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:45:47.876157 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-8ccfe414-e42f-4f19-a2c8-b65d78ef7cb0 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:45:47.876603 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-8ccfe414-e42f-4f19-a2c8-b65d78ef7cb0 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:45:47.877437 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-8ccfe414-e42f-4f19-a2c8-b65d78ef7cb0 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:45:47.877862 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-8ccfe414-e42f-4f19-a2c8-b65d78ef7cb0 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:45:47.975493 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-122aaecd-d1d7-46e0-bf9b-d5f30b76730b tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:45:47.976832 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-122aaecd-d1d7-46e0-bf9b-d5f30b76730b tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] [instance: c2c661f2-d3da-4357-a7a8-3f85fc94cc60] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:45:47.983482 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-122aaecd-d1d7-46e0-bf9b-d5f30b76730b tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:45:47.984322 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-122aaecd-d1d7-46e0-bf9b-d5f30b76730b tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:45:47.985411 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-122aaecd-d1d7-46e0-bf9b-d5f30b76730b tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:45:47.986274 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-122aaecd-d1d7-46e0-bf9b-d5f30b76730b tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:45:48.021397 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-8ccfe414-e42f-4f19-a2c8-b65d78ef7cb0 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:45:48.038259 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-8ccfe414-e42f-4f19-a2c8-b65d78ef7cb0 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:45:48.041486 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-8ccfe414-e42f-4f19-a2c8-b65d78ef7cb0 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:45:48.043135 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-8ccfe414-e42f-4f19-a2c8-b65d78ef7cb0 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] 10.222.0.30 "GET /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0" status: 200 len: 1407 microversion: 2.20 time: 0.177368 Dec 24 10:45:48.058347 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 78/149] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Dec 24 10:45:47 2021] GET /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0 => generated 1407 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 10:45:48.087492 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-a02cd965-9795-44c1-a389-eae3d6af203c tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:45:48.088214 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-a02cd965-9795-44c1-a389-eae3d6af203c tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] [instance: b18ab8db-0c1f-4343-ae07-953fc820b211] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:45:48.095161 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-a02cd965-9795-44c1-a389-eae3d6af203c tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:45:48.095626 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-a02cd965-9795-44c1-a389-eae3d6af203c tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:45:48.096410 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-a02cd965-9795-44c1-a389-eae3d6af203c tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:45:48.096865 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-a02cd965-9795-44c1-a389-eae3d6af203c tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:45:48.148130 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-122aaecd-d1d7-46e0-bf9b-d5f30b76730b tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d627b760f74f48ac560e2ce2e74e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '378bb44ad89440e49f7e290a5d31004e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:45:48.156766 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-122aaecd-d1d7-46e0-bf9b-d5f30b76730b tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] 10.222.0.30 "GET /compute/v2.1/servers/c2c661f2-d3da-4357-a7a8-3f85fc94cc60" status: 200 len: 1516 microversion: 2.1 time: 0.185124 Dec 24 10:45:48.157479 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 72/150] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:45:47 2021] GET /compute/v2.1/servers/c2c661f2-d3da-4357-a7a8-3f85fc94cc60 => generated 1516 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:45:48.174778 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-60200f77-6ca9-4f47-81fa-eda1a840bdf4 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:45:48.177560 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-60200f77-6ca9-4f47-81fa-eda1a840bdf4 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] [instance: c2c661f2-d3da-4357-a7a8-3f85fc94cc60] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:45:48.181763 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-60200f77-6ca9-4f47-81fa-eda1a840bdf4 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:45:48.182212 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-60200f77-6ca9-4f47-81fa-eda1a840bdf4 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:45:48.182968 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-60200f77-6ca9-4f47-81fa-eda1a840bdf4 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:45:48.183386 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-60200f77-6ca9-4f47-81fa-eda1a840bdf4 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:45:48.237452 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-a02cd965-9795-44c1-a389-eae3d6af203c tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ad5096717dc425c849dfe95ea55a6af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62d11172cdf4959a15ac1ffc5601aca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:45:48.245467 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.objects.instance [None req-60200f77-6ca9-4f47-81fa-eda1a840bdf4 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lazy-loading 'flavor' on Instance uuid c2c661f2-d3da-4357-a7a8-3f85fc94cc60 {{(pid=123432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 24 10:45:48.245996 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-a02cd965-9795-44c1-a389-eae3d6af203c tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] 10.222.0.30 "GET /compute/v2.1/servers/b18ab8db-0c1f-4343-ae07-953fc820b211" status: 200 len: 1506 microversion: 2.1 time: 0.167323 Dec 24 10:45:48.246817 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 79/151] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:45:48 2021] GET /compute/v2.1/servers/b18ab8db-0c1f-4343-ae07-953fc820b211 => generated 1506 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:45:48.712595 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-60200f77-6ca9-4f47-81fa-eda1a840bdf4 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] 10.222.0.30 "POST /compute/v2.1/servers/c2c661f2-d3da-4357-a7a8-3f85fc94cc60/action" status: 200 len: 32 microversion: 2.1 time: 0.542030 Dec 24 10:45:48.713247 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 73/152] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Dec 24 10:45:48 2021] POST /compute/v2.1/servers/c2c661f2-d3da-4357-a7a8-3f85fc94cc60/action => generated 32 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Dec 24 10:45:48.722196 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-b0e2a7c0-ecd5-4836-8190-74caca5590ab tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:45:48.722834 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-b0e2a7c0-ecd5-4836-8190-74caca5590ab tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] [instance: c2c661f2-d3da-4357-a7a8-3f85fc94cc60] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:45:48.729181 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-b0e2a7c0-ecd5-4836-8190-74caca5590ab tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:45:48.729624 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-b0e2a7c0-ecd5-4836-8190-74caca5590ab tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:45:48.730475 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-b0e2a7c0-ecd5-4836-8190-74caca5590ab tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:45:48.730888 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-b0e2a7c0-ecd5-4836-8190-74caca5590ab tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:45:48.862902 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-b0e2a7c0-ecd5-4836-8190-74caca5590ab tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d627b760f74f48ac560e2ce2e74e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '378bb44ad89440e49f7e290a5d31004e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:45:48.871711 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-b0e2a7c0-ecd5-4836-8190-74caca5590ab tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] 10.222.0.30 "GET /compute/v2.1/servers/c2c661f2-d3da-4357-a7a8-3f85fc94cc60" status: 200 len: 1522 microversion: 2.1 time: 0.153147 Dec 24 10:45:48.872915 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 80/153] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:45:48 2021] GET /compute/v2.1/servers/c2c661f2-d3da-4357-a7a8-3f85fc94cc60 => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:45:49.074816 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-50cbc15c-b670-4ad4-846b-46c7e9df64df tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:45:49.075507 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-50cbc15c-b670-4ad4-846b-46c7e9df64df tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] [instance: a99a6a98-4010-4f8e-a83f-fcc490f6ece0] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:45:49.086104 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-50cbc15c-b670-4ad4-846b-46c7e9df64df tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:45:49.086104 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-50cbc15c-b670-4ad4-846b-46c7e9df64df tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:45:49.086104 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-50cbc15c-b670-4ad4-846b-46c7e9df64df tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:45:49.086104 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-50cbc15c-b670-4ad4-846b-46c7e9df64df tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:45:49.445076 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-50cbc15c-b670-4ad4-846b-46c7e9df64df tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:45:49.452938 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-50cbc15c-b670-4ad4-846b-46c7e9df64df tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:45:49.454467 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-50cbc15c-b670-4ad4-846b-46c7e9df64df tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:45:49.455603 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-50cbc15c-b670-4ad4-846b-46c7e9df64df tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] 10.222.0.30 "GET /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0" status: 200 len: 1598 microversion: 2.20 time: 0.385050 Dec 24 10:45:49.456166 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 74/154] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Dec 24 10:45:49 2021] GET /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0 => generated 1598 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 10:45:49.475679 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-a0d7e21c-ded0-4730-8258-7a45aaac3680 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:45:49.476162 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-a0d7e21c-ded0-4730-8258-7a45aaac3680 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] [instance: a99a6a98-4010-4f8e-a83f-fcc490f6ece0] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:45:49.485585 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-a0d7e21c-ded0-4730-8258-7a45aaac3680 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:45:49.486246 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-a0d7e21c-ded0-4730-8258-7a45aaac3680 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:45:49.490565 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-a0d7e21c-ded0-4730-8258-7a45aaac3680 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:45:49.490565 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-a0d7e21c-ded0-4730-8258-7a45aaac3680 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:45:49.616836 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-a0d7e21c-ded0-4730-8258-7a45aaac3680 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] 10.222.0.30 "GET /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.145659 Dec 24 10:45:49.619142 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 81/155] 10.222.0.30 () {60 vars in 1315 bytes} [Fri Dec 24 10:45:49 2021] GET /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0/os-interface => generated 284 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 24 10:45:49.887983 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-513705b9-c167-46d7-aacd-e13b53d82613 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:45:49.888581 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-513705b9-c167-46d7-aacd-e13b53d82613 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] [instance: c2c661f2-d3da-4357-a7a8-3f85fc94cc60] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:45:49.894855 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-513705b9-c167-46d7-aacd-e13b53d82613 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:45:49.895432 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-513705b9-c167-46d7-aacd-e13b53d82613 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:45:49.896341 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-513705b9-c167-46d7-aacd-e13b53d82613 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:45:49.897007 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-513705b9-c167-46d7-aacd-e13b53d82613 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:45:50.038909 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-513705b9-c167-46d7-aacd-e13b53d82613 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d627b760f74f48ac560e2ce2e74e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '378bb44ad89440e49f7e290a5d31004e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:45:50.047344 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-513705b9-c167-46d7-aacd-e13b53d82613 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] 10.222.0.30 "GET /compute/v2.1/servers/c2c661f2-d3da-4357-a7a8-3f85fc94cc60" status: 200 len: 1522 microversion: 2.1 time: 0.163073 Dec 24 10:45:50.047940 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 75/156] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:45:49 2021] GET /compute/v2.1/servers/c2c661f2-d3da-4357-a7a8-3f85fc94cc60 => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 24 10:45:50.143175 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-34efa3f7-d920-48ed-821d-1f1b7b19c05f tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e3595812-0c80-474f-9154-8b721b8659f2"}} {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:45:50.144372 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-34efa3f7-d920-48ed-821d-1f1b7b19c05f tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] [instance: f77538c5-1e85-4d4f-b6cb-1c003149fac1] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:45:50.150834 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-34efa3f7-d920-48ed-821d-1f1b7b19c05f tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:45:50.151351 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-34efa3f7-d920-48ed-821d-1f1b7b19c05f tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:45:50.153052 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-34efa3f7-d920-48ed-821d-1f1b7b19c05f tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:45:50.153659 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-34efa3f7-d920-48ed-821d-1f1b7b19c05f tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:45:50.983894 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-ecd74d5a-96a2-4d85-8bed-ffbbb32aa30a tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c9534bc6-5ae7-42a7-83a7-86c2830d0d7c"}} {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:45:50.985020 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-ecd74d5a-96a2-4d85-8bed-ffbbb32aa30a tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] [instance: b18ab8db-0c1f-4343-ae07-953fc820b211] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:45:50.993565 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-ecd74d5a-96a2-4d85-8bed-ffbbb32aa30a tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:45:50.994288 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-ecd74d5a-96a2-4d85-8bed-ffbbb32aa30a tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:45:50.996129 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-ecd74d5a-96a2-4d85-8bed-ffbbb32aa30a tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:45:50.996770 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-ecd74d5a-96a2-4d85-8bed-ffbbb32aa30a tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:45:51.319849 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-34efa3f7-d920-48ed-821d-1f1b7b19c05f tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] 10.222.0.30 "POST /compute/v2.1/servers/f77538c5-1e85-4d4f-b6cb-1c003149fac1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.180399 Dec 24 10:45:51.320654 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 82/157] 10.222.0.30 () {60 vars in 1322 bytes} [Fri Dec 24 10:45:50 2021] POST /compute/v2.1/servers/f77538c5-1e85-4d4f-b6cb-1c003149fac1/os-volume_attachments => generated 194 bytes in 1182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 10:45:51.325671 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-9b121a9f-2f9a-46e4-a141-f9b95ca3f795 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:45:51.326402 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-9b121a9f-2f9a-46e4-a141-f9b95ca3f795 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] [instance: c2c661f2-d3da-4357-a7a8-3f85fc94cc60] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:45:51.333645 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-9b121a9f-2f9a-46e4-a141-f9b95ca3f795 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:45:51.334098 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-9b121a9f-2f9a-46e4-a141-f9b95ca3f795 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:45:51.334880 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-9b121a9f-2f9a-46e4-a141-f9b95ca3f795 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:45:51.335315 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-9b121a9f-2f9a-46e4-a141-f9b95ca3f795 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:45:51.494059 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-9b121a9f-2f9a-46e4-a141-f9b95ca3f795 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d627b760f74f48ac560e2ce2e74e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '378bb44ad89440e49f7e290a5d31004e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:45:51.500562 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-9b121a9f-2f9a-46e4-a141-f9b95ca3f795 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] 10.222.0.30 "GET /compute/v2.1/servers/c2c661f2-d3da-4357-a7a8-3f85fc94cc60" status: 200 len: 1522 microversion: 2.1 time: 0.178542 Dec 24 10:45:51.501182 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 83/158] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:45:51 2021] GET /compute/v2.1/servers/c2c661f2-d3da-4357-a7a8-3f85fc94cc60 => generated 1522 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:45:51.506745 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-5073f1bd-a72e-4865-a162-9ca1704400be tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:45:51.507966 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-5073f1bd-a72e-4865-a162-9ca1704400be tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] [instance: a99a6a98-4010-4f8e-a83f-fcc490f6ece0] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:45:51.513988 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-5073f1bd-a72e-4865-a162-9ca1704400be tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:45:51.514538 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-5073f1bd-a72e-4865-a162-9ca1704400be tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:45:51.515416 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-5073f1bd-a72e-4865-a162-9ca1704400be tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:45:51.515915 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-5073f1bd-a72e-4865-a162-9ca1704400be tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:45:51.596505 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-5073f1bd-a72e-4865-a162-9ca1704400be tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] 10.222.0.30 "POST /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0/action" status: 200 len: 14 microversion: 2.20 time: 0.093823 Dec 24 10:45:51.597187 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 84/159] 10.222.0.30 () {62 vars in 1318 bytes} [Fri Dec 24 10:45:51 2021] POST /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0/action => generated 14 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:45:51.602377 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [req-25848077-4a24-46be-bc20-2ce7b11e92fd req-9f9ff145-01ca-4d69-b67b-5697179ccbc9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a99a6a98-4010-4f8e-a83f-fcc490f6ece0", "tag": "e50dfc57-62cb-4d13-9e17-f48edcdb1dcc"}]} {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:45:51.603908 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 10:45:51.603908 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: warnings.warn(msg) Dec 24 10:45:51.611575 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [req-25848077-4a24-46be-bc20-2ce7b11e92fd req-9f9ff145-01ca-4d69-b67b-5697179ccbc9 service nova] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:45:51.612016 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [req-25848077-4a24-46be-bc20-2ce7b11e92fd req-9f9ff145-01ca-4d69-b67b-5697179ccbc9 service nova] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:45:51.623332 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.compute.server_external_events [req-25848077-4a24-46be-bc20-2ce7b11e92fd req-9f9ff145-01ca-4d69-b67b-5697179ccbc9 service nova] Creating event network-changed:e50dfc57-62cb-4d13-9e17-f48edcdb1dcc for instance a99a6a98-4010-4f8e-a83f-fcc490f6ece0 on hv-cinder-81644 Dec 24 10:45:51.628064 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [req-25848077-4a24-46be-bc20-2ce7b11e92fd req-9f9ff145-01ca-4d69-b67b-5697179ccbc9 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029295 Dec 24 10:45:51.628852 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 85/160] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Dec 24 10:45:51 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 10:45:52.034122 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-ecd74d5a-96a2-4d85-8bed-ffbbb32aa30a tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] 10.222.0.30 "POST /compute/v2.1/servers/b18ab8db-0c1f-4343-ae07-953fc820b211/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.053848 Dec 24 10:45:52.040785 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 76/161] 10.222.0.30 () {60 vars in 1322 bytes} [Fri Dec 24 10:45:50 2021] POST /compute/v2.1/servers/b18ab8db-0c1f-4343-ae07-953fc820b211/os-volume_attachments => generated 194 bytes in 1061 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 10:45:52.518808 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-faa48447-6c48-4c7f-b5fb-636e265dda1a tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:45:52.519563 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-faa48447-6c48-4c7f-b5fb-636e265dda1a tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] [instance: c2c661f2-d3da-4357-a7a8-3f85fc94cc60] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:45:52.526893 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-faa48447-6c48-4c7f-b5fb-636e265dda1a tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:45:52.527403 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-faa48447-6c48-4c7f-b5fb-636e265dda1a tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:45:52.528410 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-faa48447-6c48-4c7f-b5fb-636e265dda1a tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:45:52.529018 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-faa48447-6c48-4c7f-b5fb-636e265dda1a tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:45:52.609483 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-0c1ba0e2-a4a9-4846-843d-db78e7b4f945 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:45:52.610727 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-0c1ba0e2-a4a9-4846-843d-db78e7b4f945 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] [instance: a99a6a98-4010-4f8e-a83f-fcc490f6ece0] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:45:52.618792 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-0c1ba0e2-a4a9-4846-843d-db78e7b4f945 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:45:52.619235 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-0c1ba0e2-a4a9-4846-843d-db78e7b4f945 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:45:52.620009 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-0c1ba0e2-a4a9-4846-843d-db78e7b4f945 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:45:52.620478 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-0c1ba0e2-a4a9-4846-843d-db78e7b4f945 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:45:52.695670 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-faa48447-6c48-4c7f-b5fb-636e265dda1a tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d627b760f74f48ac560e2ce2e74e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '378bb44ad89440e49f7e290a5d31004e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:45:52.702805 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-faa48447-6c48-4c7f-b5fb-636e265dda1a tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] 10.222.0.30 "GET /compute/v2.1/servers/c2c661f2-d3da-4357-a7a8-3f85fc94cc60" status: 200 len: 1522 microversion: 2.1 time: 0.188519 Dec 24 10:45:52.703406 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 86/162] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:45:52 2021] GET /compute/v2.1/servers/c2c661f2-d3da-4357-a7a8-3f85fc94cc60 => generated 1522 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:45:52.714914 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-0c1ba0e2-a4a9-4846-843d-db78e7b4f945 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] 10.222.0.30 "POST /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0/action" status: 200 len: 14 microversion: 2.20 time: 0.110791 Dec 24 10:45:52.716279 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 77/163] 10.222.0.30 () {62 vars in 1318 bytes} [Fri Dec 24 10:45:52 2021] POST /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0/action => generated 14 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 24 10:45:53.719997 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-1b8319d6-2fe9-4c7e-97be-3dbbbf1a2854 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:45:53.719997 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-1b8319d6-2fe9-4c7e-97be-3dbbbf1a2854 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] [instance: c2c661f2-d3da-4357-a7a8-3f85fc94cc60] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:45:53.727097 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-852a2d4c-9696-4fc5-a4a3-d825cc6ddff1 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:45:53.732324 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-852a2d4c-9696-4fc5-a4a3-d825cc6ddff1 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] [instance: a99a6a98-4010-4f8e-a83f-fcc490f6ece0] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:45:53.743448 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-1b8319d6-2fe9-4c7e-97be-3dbbbf1a2854 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:45:53.743448 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-1b8319d6-2fe9-4c7e-97be-3dbbbf1a2854 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:45:53.743448 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-1b8319d6-2fe9-4c7e-97be-3dbbbf1a2854 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:45:53.743448 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-1b8319d6-2fe9-4c7e-97be-3dbbbf1a2854 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:45:53.743855 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-852a2d4c-9696-4fc5-a4a3-d825cc6ddff1 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:45:53.743855 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-852a2d4c-9696-4fc5-a4a3-d825cc6ddff1 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:45:53.744225 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-852a2d4c-9696-4fc5-a4a3-d825cc6ddff1 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:45:53.748667 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-852a2d4c-9696-4fc5-a4a3-d825cc6ddff1 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:45:53.827343 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-852a2d4c-9696-4fc5-a4a3-d825cc6ddff1 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] 10.222.0.30 "POST /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0/action" status: 200 len: 14 microversion: 2.20 time: 0.104650 Dec 24 10:45:53.827980 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 78/164] 10.222.0.30 () {62 vars in 1318 bytes} [Fri Dec 24 10:45:53 2021] POST /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0/action => generated 14 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:45:53.915594 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-1b8319d6-2fe9-4c7e-97be-3dbbbf1a2854 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d627b760f74f48ac560e2ce2e74e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '378bb44ad89440e49f7e290a5d31004e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:45:53.922923 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-1b8319d6-2fe9-4c7e-97be-3dbbbf1a2854 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] 10.222.0.30 "GET /compute/v2.1/servers/c2c661f2-d3da-4357-a7a8-3f85fc94cc60" status: 200 len: 1522 microversion: 2.1 time: 0.207429 Dec 24 10:45:53.923669 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 87/165] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:45:53 2021] GET /compute/v2.1/servers/c2c661f2-d3da-4357-a7a8-3f85fc94cc60 => generated 1522 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:45:54.840428 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-42e195f0-c0e8-4eb7-b314-500484a270f6 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:45:54.841954 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-42e195f0-c0e8-4eb7-b314-500484a270f6 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] [instance: a99a6a98-4010-4f8e-a83f-fcc490f6ece0] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:45:54.848688 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-42e195f0-c0e8-4eb7-b314-500484a270f6 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:45:54.849158 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-42e195f0-c0e8-4eb7-b314-500484a270f6 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:45:54.850163 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-42e195f0-c0e8-4eb7-b314-500484a270f6 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:45:54.850591 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-42e195f0-c0e8-4eb7-b314-500484a270f6 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:45:54.930630 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-42e195f0-c0e8-4eb7-b314-500484a270f6 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] 10.222.0.30 "POST /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0/action" status: 200 len: 14 microversion: 2.20 time: 0.095658 Dec 24 10:45:54.932594 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 79/166] 10.222.0.30 () {62 vars in 1318 bytes} [Fri Dec 24 10:45:54 2021] POST /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0/action => generated 14 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 24 10:45:54.939095 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-6c9dd1ba-173a-47c7-be4e-e20ae6be6ac1 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:45:54.939689 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-6c9dd1ba-173a-47c7-be4e-e20ae6be6ac1 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] [instance: c2c661f2-d3da-4357-a7a8-3f85fc94cc60] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:45:54.946172 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-6c9dd1ba-173a-47c7-be4e-e20ae6be6ac1 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:45:54.946652 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-6c9dd1ba-173a-47c7-be4e-e20ae6be6ac1 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:45:54.947474 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-6c9dd1ba-173a-47c7-be4e-e20ae6be6ac1 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:45:54.947903 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-6c9dd1ba-173a-47c7-be4e-e20ae6be6ac1 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:45:55.263449 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-6c9dd1ba-173a-47c7-be4e-e20ae6be6ac1 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d627b760f74f48ac560e2ce2e74e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '378bb44ad89440e49f7e290a5d31004e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:45:55.271556 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-6c9dd1ba-173a-47c7-be4e-e20ae6be6ac1 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] 10.222.0.30 "GET /compute/v2.1/servers/c2c661f2-d3da-4357-a7a8-3f85fc94cc60" status: 200 len: 1522 microversion: 2.1 time: 0.336008 Dec 24 10:45:55.272122 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 88/167] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:45:54 2021] GET /compute/v2.1/servers/c2c661f2-d3da-4357-a7a8-3f85fc94cc60 => generated 1522 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:45:55.942102 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-3b28fe02-c2ea-4bf3-b291-e952fbfcadd3 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:45:55.943271 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-3b28fe02-c2ea-4bf3-b291-e952fbfcadd3 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] [instance: a99a6a98-4010-4f8e-a83f-fcc490f6ece0] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:45:55.951248 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-3b28fe02-c2ea-4bf3-b291-e952fbfcadd3 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:45:55.951696 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-3b28fe02-c2ea-4bf3-b291-e952fbfcadd3 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:45:55.952675 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-3b28fe02-c2ea-4bf3-b291-e952fbfcadd3 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:45:55.953191 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-3b28fe02-c2ea-4bf3-b291-e952fbfcadd3 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:45:56.038249 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-3b28fe02-c2ea-4bf3-b291-e952fbfcadd3 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] 10.222.0.30 "POST /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0/action" status: 200 len: 14 microversion: 2.20 time: 0.100596 Dec 24 10:45:56.039149 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 80/168] 10.222.0.30 () {62 vars in 1318 bytes} [Fri Dec 24 10:45:55 2021] POST /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0/action => generated 14 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:45:56.288021 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-f86b8206-190a-40e1-96e7-81a033435066 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:45:56.288629 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-f86b8206-190a-40e1-96e7-81a033435066 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] [instance: c2c661f2-d3da-4357-a7a8-3f85fc94cc60] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:45:56.296260 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-f86b8206-190a-40e1-96e7-81a033435066 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:45:56.296702 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-f86b8206-190a-40e1-96e7-81a033435066 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:45:56.297720 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-f86b8206-190a-40e1-96e7-81a033435066 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:45:56.298155 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-f86b8206-190a-40e1-96e7-81a033435066 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:45:56.637866 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-f86b8206-190a-40e1-96e7-81a033435066 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d627b760f74f48ac560e2ce2e74e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '378bb44ad89440e49f7e290a5d31004e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:45:56.645158 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-f86b8206-190a-40e1-96e7-81a033435066 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] 10.222.0.30 "GET /compute/v2.1/servers/c2c661f2-d3da-4357-a7a8-3f85fc94cc60" status: 200 len: 1522 microversion: 2.1 time: 0.360923 Dec 24 10:45:56.646480 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 89/169] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:45:56 2021] GET /compute/v2.1/servers/c2c661f2-d3da-4357-a7a8-3f85fc94cc60 => generated 1522 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:45:57.049909 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-3668c016-d2e7-4ab6-84e7-a9ad0228d9a5 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:45:57.050937 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-3668c016-d2e7-4ab6-84e7-a9ad0228d9a5 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] [instance: a99a6a98-4010-4f8e-a83f-fcc490f6ece0] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:45:57.058345 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-3668c016-d2e7-4ab6-84e7-a9ad0228d9a5 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:45:57.058780 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-3668c016-d2e7-4ab6-84e7-a9ad0228d9a5 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:45:57.059542 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-3668c016-d2e7-4ab6-84e7-a9ad0228d9a5 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:45:57.060013 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-3668c016-d2e7-4ab6-84e7-a9ad0228d9a5 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:45:57.663750 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-6fb710a3-9f42-40ed-bd28-e082f575e5e6 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:45:57.665084 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-6fb710a3-9f42-40ed-bd28-e082f575e5e6 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] [instance: c2c661f2-d3da-4357-a7a8-3f85fc94cc60] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:45:57.670865 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-6fb710a3-9f42-40ed-bd28-e082f575e5e6 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:45:57.671298 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-6fb710a3-9f42-40ed-bd28-e082f575e5e6 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:45:57.672212 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-6fb710a3-9f42-40ed-bd28-e082f575e5e6 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:45:57.672640 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-6fb710a3-9f42-40ed-bd28-e082f575e5e6 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:45:57.825115 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-6fb710a3-9f42-40ed-bd28-e082f575e5e6 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d627b760f74f48ac560e2ce2e74e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '378bb44ad89440e49f7e290a5d31004e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:45:57.842260 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-6fb710a3-9f42-40ed-bd28-e082f575e5e6 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] 10.222.0.30 "GET /compute/v2.1/servers/c2c661f2-d3da-4357-a7a8-3f85fc94cc60" status: 200 len: 1522 microversion: 2.1 time: 0.183111 Dec 24 10:45:57.842949 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 90/170] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:45:57 2021] GET /compute/v2.1/servers/c2c661f2-d3da-4357-a7a8-3f85fc94cc60 => generated 1522 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 24 10:45:58.859129 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-956a1acb-cc1d-4c28-8494-308c9676c4f1 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:45:58.866401 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-956a1acb-cc1d-4c28-8494-308c9676c4f1 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] [instance: c2c661f2-d3da-4357-a7a8-3f85fc94cc60] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:45:58.872983 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-956a1acb-cc1d-4c28-8494-308c9676c4f1 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:45:58.875202 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-956a1acb-cc1d-4c28-8494-308c9676c4f1 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:45:58.876185 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-956a1acb-cc1d-4c28-8494-308c9676c4f1 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:45:58.876760 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-956a1acb-cc1d-4c28-8494-308c9676c4f1 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:45:59.045309 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-956a1acb-cc1d-4c28-8494-308c9676c4f1 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d627b760f74f48ac560e2ce2e74e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '378bb44ad89440e49f7e290a5d31004e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:45:59.053037 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-956a1acb-cc1d-4c28-8494-308c9676c4f1 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] 10.222.0.30 "GET /compute/v2.1/servers/c2c661f2-d3da-4357-a7a8-3f85fc94cc60" status: 200 len: 1522 microversion: 2.1 time: 0.197492 Dec 24 10:45:59.062047 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 91/171] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:45:58 2021] GET /compute/v2.1/servers/c2c661f2-d3da-4357-a7a8-3f85fc94cc60 => generated 1522 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:45:59.823065 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-3668c016-d2e7-4ab6-84e7-a9ad0228d9a5 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] 10.222.0.30 "POST /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0/action" status: 200 len: 14 microversion: 2.20 time: 2.776905 Dec 24 10:45:59.823706 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 81/172] 10.222.0.30 () {62 vars in 1318 bytes} [Fri Dec 24 10:45:57 2021] POST /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0/action => generated 14 bytes in 2779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:46:00.069625 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-5c81ac8e-3126-412a-8694-3939ee1b0277 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:46:00.070327 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-5c81ac8e-3126-412a-8694-3939ee1b0277 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] [instance: c2c661f2-d3da-4357-a7a8-3f85fc94cc60] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:46:00.076998 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-5c81ac8e-3126-412a-8694-3939ee1b0277 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:00.077517 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-5c81ac8e-3126-412a-8694-3939ee1b0277 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:00.078338 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-5c81ac8e-3126-412a-8694-3939ee1b0277 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:00.078780 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-5c81ac8e-3126-412a-8694-3939ee1b0277 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:00.211151 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-5c81ac8e-3126-412a-8694-3939ee1b0277 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d627b760f74f48ac560e2ce2e74e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '378bb44ad89440e49f7e290a5d31004e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:46:00.219653 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-5c81ac8e-3126-412a-8694-3939ee1b0277 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] 10.222.0.30 "GET /compute/v2.1/servers/c2c661f2-d3da-4357-a7a8-3f85fc94cc60" status: 200 len: 1522 microversion: 2.1 time: 0.154217 Dec 24 10:46:00.230364 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 92/173] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:46:00 2021] GET /compute/v2.1/servers/c2c661f2-d3da-4357-a7a8-3f85fc94cc60 => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:46:00.834319 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-298edc35-c682-4347-9254-f81d30a32835 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:46:00.835429 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-298edc35-c682-4347-9254-f81d30a32835 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] [instance: a99a6a98-4010-4f8e-a83f-fcc490f6ece0] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:46:00.843124 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-298edc35-c682-4347-9254-f81d30a32835 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:00.843569 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-298edc35-c682-4347-9254-f81d30a32835 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:00.844347 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-298edc35-c682-4347-9254-f81d30a32835 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:00.844780 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-298edc35-c682-4347-9254-f81d30a32835 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:00.913587 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-298edc35-c682-4347-9254-f81d30a32835 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] 10.222.0.30 "POST /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0/action" status: 200 len: 14 microversion: 2.20 time: 0.083175 Dec 24 10:46:00.914428 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 82/174] 10.222.0.30 () {62 vars in 1318 bytes} [Fri Dec 24 10:46:00 2021] POST /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0/action => generated 14 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 24 10:46:01.235972 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-de8ea812-5221-4743-be16-281faec313a8 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:46:01.238078 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-de8ea812-5221-4743-be16-281faec313a8 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] [instance: c2c661f2-d3da-4357-a7a8-3f85fc94cc60] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:46:01.244528 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-de8ea812-5221-4743-be16-281faec313a8 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:01.245007 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-de8ea812-5221-4743-be16-281faec313a8 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:01.245806 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-de8ea812-5221-4743-be16-281faec313a8 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:01.246232 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-de8ea812-5221-4743-be16-281faec313a8 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:01.393870 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-de8ea812-5221-4743-be16-281faec313a8 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d627b760f74f48ac560e2ce2e74e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '378bb44ad89440e49f7e290a5d31004e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:46:01.402096 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-de8ea812-5221-4743-be16-281faec313a8 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] 10.222.0.30 "GET /compute/v2.1/servers/c2c661f2-d3da-4357-a7a8-3f85fc94cc60" status: 200 len: 1522 microversion: 2.1 time: 0.169702 Dec 24 10:46:01.402731 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 93/175] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:46:01 2021] GET /compute/v2.1/servers/c2c661f2-d3da-4357-a7a8-3f85fc94cc60 => generated 1522 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:46:01.924685 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-576849f0-2534-4aff-964e-1120a8d93521 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:46:01.925703 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-576849f0-2534-4aff-964e-1120a8d93521 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] [instance: a99a6a98-4010-4f8e-a83f-fcc490f6ece0] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:46:01.932525 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-576849f0-2534-4aff-964e-1120a8d93521 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:01.932998 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-576849f0-2534-4aff-964e-1120a8d93521 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:01.933777 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-576849f0-2534-4aff-964e-1120a8d93521 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:01.934210 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-576849f0-2534-4aff-964e-1120a8d93521 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:02.012052 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-576849f0-2534-4aff-964e-1120a8d93521 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] 10.222.0.30 "POST /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0/action" status: 200 len: 14 microversion: 2.20 time: 0.091331 Dec 24 10:46:02.012626 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 83/176] 10.222.0.30 () {62 vars in 1318 bytes} [Fri Dec 24 10:46:01 2021] POST /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0/action => generated 14 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:46:02.418955 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-dba51ce9-9028-4b94-b2bb-3c35b29ef3a0 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:46:02.419557 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-dba51ce9-9028-4b94-b2bb-3c35b29ef3a0 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] [instance: c2c661f2-d3da-4357-a7a8-3f85fc94cc60] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:46:02.425780 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-dba51ce9-9028-4b94-b2bb-3c35b29ef3a0 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:02.426229 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-dba51ce9-9028-4b94-b2bb-3c35b29ef3a0 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:02.427546 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-dba51ce9-9028-4b94-b2bb-3c35b29ef3a0 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:02.427972 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-dba51ce9-9028-4b94-b2bb-3c35b29ef3a0 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:02.558735 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-dba51ce9-9028-4b94-b2bb-3c35b29ef3a0 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d627b760f74f48ac560e2ce2e74e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '378bb44ad89440e49f7e290a5d31004e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:46:02.565961 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-dba51ce9-9028-4b94-b2bb-3c35b29ef3a0 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] 10.222.0.30 "GET /compute/v2.1/servers/c2c661f2-d3da-4357-a7a8-3f85fc94cc60" status: 200 len: 1522 microversion: 2.1 time: 0.150927 Dec 24 10:46:02.566537 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 94/177] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:46:02 2021] GET /compute/v2.1/servers/c2c661f2-d3da-4357-a7a8-3f85fc94cc60 => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 24 10:46:03.022691 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-b4ca7ed2-b4d3-44db-8d05-114b9c6966ba tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:46:03.023684 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-b4ca7ed2-b4d3-44db-8d05-114b9c6966ba tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] [instance: a99a6a98-4010-4f8e-a83f-fcc490f6ece0] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:46:03.030827 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-b4ca7ed2-b4d3-44db-8d05-114b9c6966ba tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:03.031275 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-b4ca7ed2-b4d3-44db-8d05-114b9c6966ba tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:03.032268 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-b4ca7ed2-b4d3-44db-8d05-114b9c6966ba tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:03.032731 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-b4ca7ed2-b4d3-44db-8d05-114b9c6966ba tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:03.109274 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-b4ca7ed2-b4d3-44db-8d05-114b9c6966ba tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] 10.222.0.30 "POST /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0/action" status: 200 len: 14 microversion: 2.20 time: 0.090443 Dec 24 10:46:03.112498 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 84/178] 10.222.0.30 () {62 vars in 1318 bytes} [Fri Dec 24 10:46:03 2021] POST /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0/action => generated 14 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:46:03.583911 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-bcc78627-b039-4193-aad4-866da142b685 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:46:03.585068 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-bcc78627-b039-4193-aad4-866da142b685 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] [instance: c2c661f2-d3da-4357-a7a8-3f85fc94cc60] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:46:03.591867 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-bcc78627-b039-4193-aad4-866da142b685 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:03.592174 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-bcc78627-b039-4193-aad4-866da142b685 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:03.593299 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-bcc78627-b039-4193-aad4-866da142b685 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:03.593779 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-bcc78627-b039-4193-aad4-866da142b685 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:03.617052 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-2b9ed307-e3c4-48e7-8170-c6341350ad8c tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:46:03.617632 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-2b9ed307-e3c4-48e7-8170-c6341350ad8c tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] [instance: f77538c5-1e85-4d4f-b6cb-1c003149fac1] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:46:03.628019 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-2b9ed307-e3c4-48e7-8170-c6341350ad8c tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:03.628970 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-2b9ed307-e3c4-48e7-8170-c6341350ad8c tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:03.633208 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-2b9ed307-e3c4-48e7-8170-c6341350ad8c tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:03.633208 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-2b9ed307-e3c4-48e7-8170-c6341350ad8c tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:03.667560 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-2b9ed307-e3c4-48e7-8170-c6341350ad8c tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] [instance: f77538c5-1e85-4d4f-b6cb-1c003149fac1] Going to try to terminate instance {{(pid=123432) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 24 10:46:03.796766 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-bcc78627-b039-4193-aad4-866da142b685 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d627b760f74f48ac560e2ce2e74e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '378bb44ad89440e49f7e290a5d31004e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:46:03.804693 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-bcc78627-b039-4193-aad4-866da142b685 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] 10.222.0.30 "GET /compute/v2.1/servers/c2c661f2-d3da-4357-a7a8-3f85fc94cc60" status: 200 len: 1522 microversion: 2.1 time: 0.225074 Dec 24 10:46:03.808838 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 95/179] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:46:03 2021] GET /compute/v2.1/servers/c2c661f2-d3da-4357-a7a8-3f85fc94cc60 => generated 1522 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:46:04.045661 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-2b9ed307-e3c4-48e7-8170-c6341350ad8c tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] 10.222.0.30 "DELETE /compute/v2.1/servers/f77538c5-1e85-4d4f-b6cb-1c003149fac1" status: 204 len: 0 microversion: 2.1 time: 0.432804 Dec 24 10:46:04.047096 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 85/180] 10.222.0.30 () {58 vars in 1238 bytes} [Fri Dec 24 10:46:03 2021] DELETE /compute/v2.1/servers/f77538c5-1e85-4d4f-b6cb-1c003149fac1 => generated 0 bytes in 435 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Dec 24 10:46:04.055816 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-b523e037-d762-420f-a75f-55ecd021b437 tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:46:04.057250 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-b523e037-d762-420f-a75f-55ecd021b437 tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] [instance: f77538c5-1e85-4d4f-b6cb-1c003149fac1] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:46:04.063248 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-b523e037-d762-420f-a75f-55ecd021b437 tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:04.063686 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-b523e037-d762-420f-a75f-55ecd021b437 tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:04.064642 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-b523e037-d762-420f-a75f-55ecd021b437 tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:04.065090 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-b523e037-d762-420f-a75f-55ecd021b437 tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:04.121257 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-f277f282-b369-4ab4-8d7c-8c50041862ff tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:46:04.123007 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-f277f282-b369-4ab4-8d7c-8c50041862ff tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] [instance: a99a6a98-4010-4f8e-a83f-fcc490f6ece0] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:46:04.132069 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-f277f282-b369-4ab4-8d7c-8c50041862ff tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:04.132739 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-f277f282-b369-4ab4-8d7c-8c50041862ff tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:04.134173 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-f277f282-b369-4ab4-8d7c-8c50041862ff tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:04.134745 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-f277f282-b369-4ab4-8d7c-8c50041862ff tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:04.220862 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-f277f282-b369-4ab4-8d7c-8c50041862ff tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] 10.222.0.30 "POST /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0/action" status: 200 len: 14 microversion: 2.20 time: 0.104340 Dec 24 10:46:04.224782 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 86/181] 10.222.0.30 () {62 vars in 1318 bytes} [Fri Dec 24 10:46:04 2021] POST /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0/action => generated 14 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 24 10:46:04.239356 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-b523e037-d762-420f-a75f-55ecd021b437 tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75a06733f5d4b7e8044fe6a9914a5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52385c4779dd49e7b3f0d9e56a8d2d26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:46:04.256371 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-b523e037-d762-420f-a75f-55ecd021b437 tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] 10.222.0.30 "GET /compute/v2.1/servers/f77538c5-1e85-4d4f-b6cb-1c003149fac1" status: 200 len: 1554 microversion: 2.1 time: 0.204555 Dec 24 10:46:04.256988 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 96/182] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:46:04 2021] GET /compute/v2.1/servers/f77538c5-1e85-4d4f-b6cb-1c003149fac1 => generated 1554 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 24 10:46:04.821488 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-5bfdafd6-becf-4c91-8012-d3f25eea7a96 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:46:04.822212 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-5bfdafd6-becf-4c91-8012-d3f25eea7a96 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] [instance: c2c661f2-d3da-4357-a7a8-3f85fc94cc60] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:46:04.828421 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-5bfdafd6-becf-4c91-8012-d3f25eea7a96 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:04.829242 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-5bfdafd6-becf-4c91-8012-d3f25eea7a96 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:04.830211 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-5bfdafd6-becf-4c91-8012-d3f25eea7a96 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:04.830641 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-5bfdafd6-becf-4c91-8012-d3f25eea7a96 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:04.982969 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-5bfdafd6-becf-4c91-8012-d3f25eea7a96 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d627b760f74f48ac560e2ce2e74e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '378bb44ad89440e49f7e290a5d31004e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:46:04.990466 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-5bfdafd6-becf-4c91-8012-d3f25eea7a96 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] 10.222.0.30 "GET /compute/v2.1/servers/c2c661f2-d3da-4357-a7a8-3f85fc94cc60" status: 200 len: 1522 microversion: 2.1 time: 0.173023 Dec 24 10:46:04.991196 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 87/183] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:46:04 2021] GET /compute/v2.1/servers/c2c661f2-d3da-4357-a7a8-3f85fc94cc60 => generated 1522 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:46:05.231649 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-31aae898-c694-4c58-a07d-164b536e8742 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:46:05.232743 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-31aae898-c694-4c58-a07d-164b536e8742 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] [instance: a99a6a98-4010-4f8e-a83f-fcc490f6ece0] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:46:05.238873 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-31aae898-c694-4c58-a07d-164b536e8742 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:05.239883 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-31aae898-c694-4c58-a07d-164b536e8742 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:05.240767 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-31aae898-c694-4c58-a07d-164b536e8742 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:05.241303 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-31aae898-c694-4c58-a07d-164b536e8742 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:05.274143 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-89dd495d-9837-4acf-82fd-d8a90a93ce47 tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:46:05.274900 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-89dd495d-9837-4acf-82fd-d8a90a93ce47 tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] [instance: f77538c5-1e85-4d4f-b6cb-1c003149fac1] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:46:05.281359 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-89dd495d-9837-4acf-82fd-d8a90a93ce47 tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:05.282083 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-89dd495d-9837-4acf-82fd-d8a90a93ce47 tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:05.283152 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-89dd495d-9837-4acf-82fd-d8a90a93ce47 tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:05.283706 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-89dd495d-9837-4acf-82fd-d8a90a93ce47 tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:05.352988 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-31aae898-c694-4c58-a07d-164b536e8742 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] 10.222.0.30 "POST /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0/action" status: 200 len: 6451 microversion: 2.20 time: 0.124676 Dec 24 10:46:05.353977 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 97/184] 10.222.0.30 () {62 vars in 1318 bytes} [Fri Dec 24 10:46:05 2021] POST /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0/action => generated 6451 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 10:46:05.414699 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-89dd495d-9837-4acf-82fd-d8a90a93ce47 tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75a06733f5d4b7e8044fe6a9914a5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52385c4779dd49e7b3f0d9e56a8d2d26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:46:05.422661 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-89dd495d-9837-4acf-82fd-d8a90a93ce47 tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] 10.222.0.30 "GET /compute/v2.1/servers/f77538c5-1e85-4d4f-b6cb-1c003149fac1" status: 200 len: 1554 microversion: 2.1 time: 0.152743 Dec 24 10:46:05.423230 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 88/185] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:46:05 2021] GET /compute/v2.1/servers/f77538c5-1e85-4d4f-b6cb-1c003149fac1 => generated 1554 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 24 10:46:06.016313 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-328c4c2b-6ae3-4dc4-991c-e78500fda6e4 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:46:06.017149 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-328c4c2b-6ae3-4dc4-991c-e78500fda6e4 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] [instance: c2c661f2-d3da-4357-a7a8-3f85fc94cc60] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:46:06.025743 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-328c4c2b-6ae3-4dc4-991c-e78500fda6e4 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:06.026434 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-328c4c2b-6ae3-4dc4-991c-e78500fda6e4 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:06.027529 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-328c4c2b-6ae3-4dc4-991c-e78500fda6e4 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:06.028063 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-328c4c2b-6ae3-4dc4-991c-e78500fda6e4 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:06.198176 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-328c4c2b-6ae3-4dc4-991c-e78500fda6e4 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d627b760f74f48ac560e2ce2e74e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '378bb44ad89440e49f7e290a5d31004e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:46:06.205312 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-328c4c2b-6ae3-4dc4-991c-e78500fda6e4 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] 10.222.0.30 "GET /compute/v2.1/servers/c2c661f2-d3da-4357-a7a8-3f85fc94cc60" status: 200 len: 1522 microversion: 2.1 time: 0.193644 Dec 24 10:46:06.205925 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 98/186] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:46:06 2021] GET /compute/v2.1/servers/c2c661f2-d3da-4357-a7a8-3f85fc94cc60 => generated 1522 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:46:06.364509 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-e93c34ca-78b5-418e-b0a3-fe9165a87ed1 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:46:06.371926 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-e93c34ca-78b5-418e-b0a3-fe9165a87ed1 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] [instance: a99a6a98-4010-4f8e-a83f-fcc490f6ece0] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:46:06.393710 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-e93c34ca-78b5-418e-b0a3-fe9165a87ed1 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:06.394355 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-e93c34ca-78b5-418e-b0a3-fe9165a87ed1 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:06.395350 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-e93c34ca-78b5-418e-b0a3-fe9165a87ed1 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:06.396320 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-e93c34ca-78b5-418e-b0a3-fe9165a87ed1 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:06.440140 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-8e01452d-d306-4b1e-a2b5-6d941e5fc663 tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:46:06.440965 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-8e01452d-d306-4b1e-a2b5-6d941e5fc663 tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] [instance: f77538c5-1e85-4d4f-b6cb-1c003149fac1] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:46:06.449023 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-8e01452d-d306-4b1e-a2b5-6d941e5fc663 tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:06.449627 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-8e01452d-d306-4b1e-a2b5-6d941e5fc663 tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:06.450633 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-8e01452d-d306-4b1e-a2b5-6d941e5fc663 tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:06.451240 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-8e01452d-d306-4b1e-a2b5-6d941e5fc663 tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:06.512378 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-e93c34ca-78b5-418e-b0a3-fe9165a87ed1 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] 10.222.0.30 "POST /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0/action" status: 200 len: 10009 microversion: 2.20 time: 0.152120 Dec 24 10:46:06.517757 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 89/187] 10.222.0.30 () {62 vars in 1318 bytes} [Fri Dec 24 10:46:06 2021] POST /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0/action => generated 10009 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 24 10:46:06.598762 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-8e01452d-d306-4b1e-a2b5-6d941e5fc663 tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75a06733f5d4b7e8044fe6a9914a5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52385c4779dd49e7b3f0d9e56a8d2d26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:46:06.617279 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-8e01452d-d306-4b1e-a2b5-6d941e5fc663 tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] 10.222.0.30 "GET /compute/v2.1/servers/f77538c5-1e85-4d4f-b6cb-1c003149fac1" status: 200 len: 1554 microversion: 2.1 time: 0.171943 Dec 24 10:46:06.617279 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 99/188] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:46:06 2021] GET /compute/v2.1/servers/f77538c5-1e85-4d4f-b6cb-1c003149fac1 => generated 1554 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 24 10:46:07.223165 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-08cd38b6-ed5b-4d48-9297-623981b695e2 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:46:07.224787 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-08cd38b6-ed5b-4d48-9297-623981b695e2 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] [instance: c2c661f2-d3da-4357-a7a8-3f85fc94cc60] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:46:07.231851 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-08cd38b6-ed5b-4d48-9297-623981b695e2 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:07.232295 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-08cd38b6-ed5b-4d48-9297-623981b695e2 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:07.247831 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-08cd38b6-ed5b-4d48-9297-623981b695e2 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:07.248695 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-08cd38b6-ed5b-4d48-9297-623981b695e2 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:07.525247 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-0e0dfd9a-b2d7-4170-930a-9f0331e3fe95 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:46:07.529186 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-0e0dfd9a-b2d7-4170-930a-9f0331e3fe95 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] [instance: a99a6a98-4010-4f8e-a83f-fcc490f6ece0] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:46:07.539601 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-0e0dfd9a-b2d7-4170-930a-9f0331e3fe95 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:07.540252 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-0e0dfd9a-b2d7-4170-930a-9f0331e3fe95 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:07.541964 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-0e0dfd9a-b2d7-4170-930a-9f0331e3fe95 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:07.542738 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-0e0dfd9a-b2d7-4170-930a-9f0331e3fe95 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:07.645611 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-08cd38b6-ed5b-4d48-9297-623981b695e2 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d627b760f74f48ac560e2ce2e74e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '378bb44ad89440e49f7e290a5d31004e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:46:07.653930 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-0e0dfd9a-b2d7-4170-930a-9f0331e3fe95 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] 10.222.0.30 "POST /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0/action" status: 200 len: 15025 microversion: 2.20 time: 0.127568 Dec 24 10:46:07.653930 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 100/189] 10.222.0.30 () {62 vars in 1318 bytes} [Fri Dec 24 10:46:07 2021] POST /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0/action => generated 15025 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 24 10:46:07.656655 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-08cd38b6-ed5b-4d48-9297-623981b695e2 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] 10.222.0.30 "GET /compute/v2.1/servers/c2c661f2-d3da-4357-a7a8-3f85fc94cc60" status: 200 len: 1522 microversion: 2.1 time: 0.437514 Dec 24 10:46:07.666365 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 90/190] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:46:07 2021] GET /compute/v2.1/servers/c2c661f2-d3da-4357-a7a8-3f85fc94cc60 => generated 1522 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:46:07.668783 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-e417e5d7-8e74-4320-8502-92fe47357d09 tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:46:07.669569 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-e417e5d7-8e74-4320-8502-92fe47357d09 tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] [instance: f77538c5-1e85-4d4f-b6cb-1c003149fac1] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:46:07.672347 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [req-936aa8e7-43a1-4da0-a436-e91f18a492e9 req-adba7913-7531-4f1d-8d52-6fe4dc9355fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f77538c5-1e85-4d4f-b6cb-1c003149fac1", "name": "network-vif-deleted", "tag": "194d1221-8d93-48d8-9ae0-aff4aac7c1b9"}]} {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:46:07.679872 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-e417e5d7-8e74-4320-8502-92fe47357d09 tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:07.680130 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 10:46:07.680130 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: warnings.warn(msg) Dec 24 10:46:07.680761 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-e417e5d7-8e74-4320-8502-92fe47357d09 tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:07.681860 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-e417e5d7-8e74-4320-8502-92fe47357d09 tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:07.682631 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-e417e5d7-8e74-4320-8502-92fe47357d09 tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:07.691080 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [req-936aa8e7-43a1-4da0-a436-e91f18a492e9 req-adba7913-7531-4f1d-8d52-6fe4dc9355fe service nova] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:07.691593 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [req-936aa8e7-43a1-4da0-a436-e91f18a492e9 req-adba7913-7531-4f1d-8d52-6fe4dc9355fe service nova] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:07.703771 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.compute.server_external_events [req-936aa8e7-43a1-4da0-a436-e91f18a492e9 req-adba7913-7531-4f1d-8d52-6fe4dc9355fe service nova] Creating event network-vif-deleted:194d1221-8d93-48d8-9ae0-aff4aac7c1b9 for instance f77538c5-1e85-4d4f-b6cb-1c003149fac1 on hv-cinder-81644 Dec 24 10:46:07.709638 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [req-936aa8e7-43a1-4da0-a436-e91f18a492e9 req-adba7913-7531-4f1d-8d52-6fe4dc9355fe service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041937 Dec 24 10:46:07.710474 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 91/191] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Dec 24 10:46:07 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 10:46:07.799785 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-e417e5d7-8e74-4320-8502-92fe47357d09 tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75a06733f5d4b7e8044fe6a9914a5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52385c4779dd49e7b3f0d9e56a8d2d26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:46:07.818520 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-e417e5d7-8e74-4320-8502-92fe47357d09 tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] 10.222.0.30 "GET /compute/v2.1/servers/f77538c5-1e85-4d4f-b6cb-1c003149fac1" status: 200 len: 1512 microversion: 2.1 time: 0.159413 Dec 24 10:46:07.829058 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 101/192] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:46:07 2021] GET /compute/v2.1/servers/f77538c5-1e85-4d4f-b6cb-1c003149fac1 => generated 1512 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:46:08.662605 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-ec085c0a-bc05-4c64-917c-0bc30ca7ae98 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:46:08.663585 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-ec085c0a-bc05-4c64-917c-0bc30ca7ae98 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] [instance: a99a6a98-4010-4f8e-a83f-fcc490f6ece0] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:46:08.669573 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-ec085c0a-bc05-4c64-917c-0bc30ca7ae98 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:08.670021 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-ec085c0a-bc05-4c64-917c-0bc30ca7ae98 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:08.670791 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-ec085c0a-bc05-4c64-917c-0bc30ca7ae98 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:08.671240 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-ec085c0a-bc05-4c64-917c-0bc30ca7ae98 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:08.673033 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-ce2e4c26-7868-423c-a2fe-5db2cb56cf4b tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:46:08.673864 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-ce2e4c26-7868-423c-a2fe-5db2cb56cf4b tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] [instance: c2c661f2-d3da-4357-a7a8-3f85fc94cc60] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:46:08.680579 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-ce2e4c26-7868-423c-a2fe-5db2cb56cf4b tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:08.681259 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-ce2e4c26-7868-423c-a2fe-5db2cb56cf4b tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:08.682044 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-ce2e4c26-7868-423c-a2fe-5db2cb56cf4b tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:08.682478 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-ce2e4c26-7868-423c-a2fe-5db2cb56cf4b tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:08.757448 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-ec085c0a-bc05-4c64-917c-0bc30ca7ae98 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] 10.222.0.30 "POST /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0/action" status: 200 len: 17659 microversion: 2.20 time: 0.099724 Dec 24 10:46:08.758401 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 92/193] 10.222.0.30 () {62 vars in 1318 bytes} [Fri Dec 24 10:46:08 2021] POST /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0/action => generated 17659 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 24 10:46:08.837026 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-ce2e4c26-7868-423c-a2fe-5db2cb56cf4b tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d627b760f74f48ac560e2ce2e74e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '378bb44ad89440e49f7e290a5d31004e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:46:08.837146 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-c3e3b88f-05ee-4484-95d6-6a720903dd84 tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:46:08.837933 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-c3e3b88f-05ee-4484-95d6-6a720903dd84 tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] [instance: f77538c5-1e85-4d4f-b6cb-1c003149fac1] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:46:08.844983 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-c3e3b88f-05ee-4484-95d6-6a720903dd84 tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:08.849131 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-c3e3b88f-05ee-4484-95d6-6a720903dd84 tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:08.849531 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-ce2e4c26-7868-423c-a2fe-5db2cb56cf4b tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] 10.222.0.30 "GET /compute/v2.1/servers/c2c661f2-d3da-4357-a7a8-3f85fc94cc60" status: 200 len: 1522 microversion: 2.1 time: 0.175484 Dec 24 10:46:08.849633 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-c3e3b88f-05ee-4484-95d6-6a720903dd84 tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:08.849633 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-c3e3b88f-05ee-4484-95d6-6a720903dd84 tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:08.849898 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 102/194] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:46:08 2021] GET /compute/v2.1/servers/c2c661f2-d3da-4357-a7a8-3f85fc94cc60 => generated 1522 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 24 10:46:08.929645 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-c3e3b88f-05ee-4484-95d6-6a720903dd84 tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75a06733f5d4b7e8044fe6a9914a5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52385c4779dd49e7b3f0d9e56a8d2d26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:46:08.938681 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-c3e3b88f-05ee-4484-95d6-6a720903dd84 tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] 10.222.0.30 "GET /compute/v2.1/servers/f77538c5-1e85-4d4f-b6cb-1c003149fac1" status: 200 len: 1346 microversion: 2.1 time: 0.106691 Dec 24 10:46:08.952854 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 93/195] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:46:08 2021] GET /compute/v2.1/servers/f77538c5-1e85-4d4f-b6cb-1c003149fac1 => generated 1346 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 24 10:46:09.776652 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-60ab3da2-7691-47f9-9a5a-0549ffd6be58 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:46:09.777548 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-60ab3da2-7691-47f9-9a5a-0549ffd6be58 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] [instance: a99a6a98-4010-4f8e-a83f-fcc490f6ece0] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:46:09.784083 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-60ab3da2-7691-47f9-9a5a-0549ffd6be58 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:09.784536 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-60ab3da2-7691-47f9-9a5a-0549ffd6be58 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:09.785351 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-60ab3da2-7691-47f9-9a5a-0549ffd6be58 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:09.785845 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-60ab3da2-7691-47f9-9a5a-0549ffd6be58 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:09.861577 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-3bd7205b-3225-4f5f-9303-8626bccf5ca6 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:46:09.862755 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-3bd7205b-3225-4f5f-9303-8626bccf5ca6 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] [instance: c2c661f2-d3da-4357-a7a8-3f85fc94cc60] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:46:09.864409 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-60ab3da2-7691-47f9-9a5a-0549ffd6be58 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] 10.222.0.30 "POST /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0/action" status: 200 len: 17659 microversion: 2.20 time: 0.091545 Dec 24 10:46:09.865333 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 103/196] 10.222.0.30 () {62 vars in 1318 bytes} [Fri Dec 24 10:46:09 2021] POST /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0/action => generated 17659 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 24 10:46:09.872648 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-3bd7205b-3225-4f5f-9303-8626bccf5ca6 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:09.873056 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-3bd7205b-3225-4f5f-9303-8626bccf5ca6 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:09.877292 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-3bd7205b-3225-4f5f-9303-8626bccf5ca6 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:09.877292 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-3bd7205b-3225-4f5f-9303-8626bccf5ca6 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:09.971684 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-b9d82cbb-af6e-48d1-b5cf-d020fa3fcd0c tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:46:09.972391 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-b9d82cbb-af6e-48d1-b5cf-d020fa3fcd0c tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] [instance: f77538c5-1e85-4d4f-b6cb-1c003149fac1] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:46:09.991044 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-b9d82cbb-af6e-48d1-b5cf-d020fa3fcd0c tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:09.991044 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-b9d82cbb-af6e-48d1-b5cf-d020fa3fcd0c tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:09.994216 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-b9d82cbb-af6e-48d1-b5cf-d020fa3fcd0c tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:09.994701 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-b9d82cbb-af6e-48d1-b5cf-d020fa3fcd0c tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:10.028986 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-3bd7205b-3225-4f5f-9303-8626bccf5ca6 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d627b760f74f48ac560e2ce2e74e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '378bb44ad89440e49f7e290a5d31004e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:46:10.029752 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-b9d82cbb-af6e-48d1-b5cf-d020fa3fcd0c tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:10.030204 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-b9d82cbb-af6e-48d1-b5cf-d020fa3fcd0c tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:10.030891 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.objects.instance [None req-b9d82cbb-af6e-48d1-b5cf-d020fa3fcd0c tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] Lazy-loading 'fault' on Instance uuid f77538c5-1e85-4d4f-b6cb-1c003149fac1 {{(pid=123431) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 24 10:46:10.038676 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-3bd7205b-3225-4f5f-9303-8626bccf5ca6 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] 10.222.0.30 "GET /compute/v2.1/servers/c2c661f2-d3da-4357-a7a8-3f85fc94cc60" status: 200 len: 1522 microversion: 2.1 time: 0.180657 Dec 24 10:46:10.039799 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 94/197] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:46:09 2021] GET /compute/v2.1/servers/c2c661f2-d3da-4357-a7a8-3f85fc94cc60 => generated 1522 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:46:10.084090 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-b9d82cbb-af6e-48d1-b5cf-d020fa3fcd0c tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75a06733f5d4b7e8044fe6a9914a5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52385c4779dd49e7b3f0d9e56a8d2d26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:46:10.097169 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-b9d82cbb-af6e-48d1-b5cf-d020fa3fcd0c tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] 10.222.0.30 "GET /compute/v2.1/servers/f77538c5-1e85-4d4f-b6cb-1c003149fac1" status: 200 len: 1351 microversion: 2.1 time: 0.130423 Dec 24 10:46:10.098864 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 104/198] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:46:09 2021] GET /compute/v2.1/servers/f77538c5-1e85-4d4f-b6cb-1c003149fac1 => generated 1351 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 24 10:46:10.875420 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-2ad4a07d-88d9-48e3-8c53-1a474903ac9e tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:46:10.876954 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-2ad4a07d-88d9-48e3-8c53-1a474903ac9e tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] [instance: a99a6a98-4010-4f8e-a83f-fcc490f6ece0] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:46:10.884265 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-2ad4a07d-88d9-48e3-8c53-1a474903ac9e tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:10.884706 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-2ad4a07d-88d9-48e3-8c53-1a474903ac9e tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:10.885512 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-2ad4a07d-88d9-48e3-8c53-1a474903ac9e tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:10.886016 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-2ad4a07d-88d9-48e3-8c53-1a474903ac9e tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:10.969020 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-2ad4a07d-88d9-48e3-8c53-1a474903ac9e tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] 10.222.0.30 "POST /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0/action" status: 200 len: 19446 microversion: 2.20 time: 0.096543 Dec 24 10:46:10.975597 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 95/199] 10.222.0.30 () {62 vars in 1318 bytes} [Fri Dec 24 10:46:10 2021] POST /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0/action => generated 19446 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 24 10:46:11.055100 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-3041a8cc-a875-4b52-b56b-0642f9decbd9 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:46:11.055711 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-3041a8cc-a875-4b52-b56b-0642f9decbd9 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] [instance: c2c661f2-d3da-4357-a7a8-3f85fc94cc60] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:46:11.062576 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-3041a8cc-a875-4b52-b56b-0642f9decbd9 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:11.063048 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-3041a8cc-a875-4b52-b56b-0642f9decbd9 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:11.063822 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-3041a8cc-a875-4b52-b56b-0642f9decbd9 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:11.064257 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-3041a8cc-a875-4b52-b56b-0642f9decbd9 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:11.117490 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-f9d4e543-e838-49b9-b724-9d9fc7eb4249 tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:46:11.118494 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-f9d4e543-e838-49b9-b724-9d9fc7eb4249 tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] [instance: f77538c5-1e85-4d4f-b6cb-1c003149fac1] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:46:11.134769 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-f9d4e543-e838-49b9-b724-9d9fc7eb4249 tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:11.134769 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-f9d4e543-e838-49b9-b724-9d9fc7eb4249 tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:11.134769 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-f9d4e543-e838-49b9-b724-9d9fc7eb4249 tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:11.134769 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-f9d4e543-e838-49b9-b724-9d9fc7eb4249 tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:11.151818 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.wsgi [None req-f9d4e543-e838-49b9-b724-9d9fc7eb4249 tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] HTTP exception thrown: Instance f77538c5-1e85-4d4f-b6cb-1c003149fac1 could not be found. Dec 24 10:46:11.152653 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-f9d4e543-e838-49b9-b724-9d9fc7eb4249 tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] Returning 404 to user: Instance f77538c5-1e85-4d4f-b6cb-1c003149fac1 could not be found. {{(pid=123432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 24 10:46:11.153862 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-f9d4e543-e838-49b9-b724-9d9fc7eb4249 tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] 10.222.0.30 "GET /compute/v2.1/servers/f77538c5-1e85-4d4f-b6cb-1c003149fac1" status: 404 len: 111 microversion: 2.1 time: 0.042212 Dec 24 10:46:11.154711 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 96/200] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:46:11 2021] GET /compute/v2.1/servers/f77538c5-1e85-4d4f-b6cb-1c003149fac1 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 24 10:46:11.251054 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-3041a8cc-a875-4b52-b56b-0642f9decbd9 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d627b760f74f48ac560e2ce2e74e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '378bb44ad89440e49f7e290a5d31004e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:46:11.259360 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-3041a8cc-a875-4b52-b56b-0642f9decbd9 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] 10.222.0.30 "GET /compute/v2.1/servers/c2c661f2-d3da-4357-a7a8-3f85fc94cc60" status: 200 len: 1522 microversion: 2.1 time: 0.207708 Dec 24 10:46:11.260214 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 105/201] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:46:11 2021] GET /compute/v2.1/servers/c2c661f2-d3da-4357-a7a8-3f85fc94cc60 => generated 1522 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:46:11.835380 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-309fb17b-e3ab-4c2a-a74b-62232dbee43e tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1951171766", "imageRef": "fae8172d-77c4-4f40-905a-7285c185448c", "flavorRef": "452", "networks": [{"uuid": "8016a0c6-9874-4e24-99d5-a347d449be0f"}]}} {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:46:11.888302 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.network.neutron [None req-309fb17b-e3ab-4c2a-a74b-62232dbee43e tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] validate_networks() for [('8016a0c6-9874-4e24-99d5-a347d449be0f', None, None, None, None, None)] {{(pid=123432) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 24 10:46:11.982328 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-5eb422ec-cfd3-496a-b116-accfa5d42350 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:46:11.983327 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-5eb422ec-cfd3-496a-b116-accfa5d42350 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] [instance: a99a6a98-4010-4f8e-a83f-fcc490f6ece0] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:46:11.992210 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-5eb422ec-cfd3-496a-b116-accfa5d42350 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:11.995144 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-5eb422ec-cfd3-496a-b116-accfa5d42350 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:11.995656 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-5eb422ec-cfd3-496a-b116-accfa5d42350 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:11.996091 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-5eb422ec-cfd3-496a-b116-accfa5d42350 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:12.084358 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-5eb422ec-cfd3-496a-b116-accfa5d42350 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] 10.222.0.30 "POST /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0/action" status: 200 len: 21966 microversion: 2.20 time: 0.105674 Dec 24 10:46:12.086105 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 106/202] 10.222.0.30 () {62 vars in 1318 bytes} [Fri Dec 24 10:46:11 2021] POST /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0/action => generated 21966 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 24 10:46:12.095216 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-24f6de52-cfe8-4ea6-9b56-47148971aed0 tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:46:12.095216 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-24f6de52-cfe8-4ea6-9b56-47148971aed0 tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] [instance: f77538c5-1e85-4d4f-b6cb-1c003149fac1] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:46:12.103027 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-24f6de52-cfe8-4ea6-9b56-47148971aed0 tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:12.103748 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-24f6de52-cfe8-4ea6-9b56-47148971aed0 tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:12.105657 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-24f6de52-cfe8-4ea6-9b56-47148971aed0 tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:12.106400 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-24f6de52-cfe8-4ea6-9b56-47148971aed0 tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:12.124461 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.wsgi [None req-24f6de52-cfe8-4ea6-9b56-47148971aed0 tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] HTTP exception thrown: Instance f77538c5-1e85-4d4f-b6cb-1c003149fac1 could not be found. Dec 24 10:46:12.125084 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-24f6de52-cfe8-4ea6-9b56-47148971aed0 tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] Returning 404 to user: Instance f77538c5-1e85-4d4f-b6cb-1c003149fac1 could not be found. {{(pid=123431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 24 10:46:12.125912 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-24f6de52-cfe8-4ea6-9b56-47148971aed0 tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] 10.222.0.30 "GET /compute/v2.1/servers/f77538c5-1e85-4d4f-b6cb-1c003149fac1/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.038506 Dec 24 10:46:12.131808 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 107/203] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Dec 24 10:46:12 2021] GET /compute/v2.1/servers/f77538c5-1e85-4d4f-b6cb-1c003149fac1/os-volume_attachments => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 24 10:46:12.275995 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-6a7f3827-b46d-4dca-8bd4-4ab6985bbf4f tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:46:12.276938 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-6a7f3827-b46d-4dca-8bd4-4ab6985bbf4f tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] [instance: c2c661f2-d3da-4357-a7a8-3f85fc94cc60] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:46:12.283199 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-6a7f3827-b46d-4dca-8bd4-4ab6985bbf4f tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:12.283850 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-6a7f3827-b46d-4dca-8bd4-4ab6985bbf4f tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:12.284782 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-6a7f3827-b46d-4dca-8bd4-4ab6985bbf4f tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:12.285238 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-6a7f3827-b46d-4dca-8bd4-4ab6985bbf4f tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:12.324172 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.virt.hardware [None req-309fb17b-e3ab-4c2a-a74b-62232dbee43e tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Flavor limits 0:0:0 {{(pid=123432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 24 10:46:12.324593 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.virt.hardware [None req-309fb17b-e3ab-4c2a-a74b-62232dbee43e tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Image limits 0:0:0 {{(pid=123432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 24 10:46:12.325835 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.virt.hardware [None req-309fb17b-e3ab-4c2a-a74b-62232dbee43e tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Flavor pref 0:0:0 {{(pid=123432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 24 10:46:12.326245 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.virt.hardware [None req-309fb17b-e3ab-4c2a-a74b-62232dbee43e tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Image pref 0:0:0 {{(pid=123432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 24 10:46:12.326672 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.virt.hardware [None req-309fb17b-e3ab-4c2a-a74b-62232dbee43e tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 24 10:46:12.336266 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-309fb17b-e3ab-4c2a-a74b-62232dbee43e tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:12.342991 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-309fb17b-e3ab-4c2a-a74b-62232dbee43e tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:12.342991 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-309fb17b-e3ab-4c2a-a74b-62232dbee43e tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:12.342991 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-309fb17b-e3ab-4c2a-a74b-62232dbee43e tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:12.354613 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.quota [None req-309fb17b-e3ab-4c2a-a74b-62232dbee43e tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Getting quotas for project e62d11172cdf4959a15ac1ffc5601aca. Resources: {'instances', 'cores', 'ram'} {{(pid=123432) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 24 10:46:12.358631 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.quota [None req-309fb17b-e3ab-4c2a-a74b-62232dbee43e tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Getting quotas for user 5ad5096717dc425c849dfe95ea55a6af and project e62d11172cdf4959a15ac1ffc5601aca. Resources: {'instances', 'cores', 'ram'} {{(pid=123432) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 24 10:46:12.369900 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-309fb17b-e3ab-4c2a-a74b-62232dbee43e tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Going to run 1 instances... {{(pid=123432) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 24 10:46:12.372241 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-309fb17b-e3ab-4c2a-a74b-62232dbee43e tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] [instance: 6427d66b-d1b3-4cc1-ba3e-f8a8c479189c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fae8172d-77c4-4f40-905a-7285c185448c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123432) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 24 10:46:12.416931 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-6a7f3827-b46d-4dca-8bd4-4ab6985bbf4f tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d627b760f74f48ac560e2ce2e74e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '378bb44ad89440e49f7e290a5d31004e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:46:12.424247 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-6a7f3827-b46d-4dca-8bd4-4ab6985bbf4f tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] 10.222.0.30 "GET /compute/v2.1/servers/c2c661f2-d3da-4357-a7a8-3f85fc94cc60" status: 200 len: 1522 microversion: 2.1 time: 0.152131 Dec 24 10:46:12.424799 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 108/204] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:46:12 2021] GET /compute/v2.1/servers/c2c661f2-d3da-4357-a7a8-3f85fc94cc60 => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 24 10:46:12.625628 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-309fb17b-e3ab-4c2a-a74b-62232dbee43e tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.794241 Dec 24 10:46:12.626198 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 97/205] 10.222.0.30 () {60 vars in 1146 bytes} [Fri Dec 24 10:46:11 2021] POST /compute/v2.1/servers => generated 380 bytes in 795 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 24 10:46:12.636502 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-8a4fbbcc-b67c-4b14-a47c-07cfc72060eb tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:46:12.637219 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-8a4fbbcc-b67c-4b14-a47c-07cfc72060eb tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] [instance: 6427d66b-d1b3-4cc1-ba3e-f8a8c479189c] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:46:12.696968 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-8a4fbbcc-b67c-4b14-a47c-07cfc72060eb tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ad5096717dc425c849dfe95ea55a6af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62d11172cdf4959a15ac1ffc5601aca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:46:12.705080 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-8a4fbbcc-b67c-4b14-a47c-07cfc72060eb tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] 10.222.0.30 "GET /compute/v2.1/servers/6427d66b-d1b3-4cc1-ba3e-f8a8c479189c" status: 200 len: 1218 microversion: 2.1 time: 0.072034 Dec 24 10:46:12.706396 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 109/206] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:46:12 2021] GET /compute/v2.1/servers/6427d66b-d1b3-4cc1-ba3e-f8a8c479189c => generated 1218 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:46:13.098110 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-ef2c8e90-6537-455a-9da3-fae6e16c6697 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:46:13.103259 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-ef2c8e90-6537-455a-9da3-fae6e16c6697 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] [instance: a99a6a98-4010-4f8e-a83f-fcc490f6ece0] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:46:13.111000 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-ef2c8e90-6537-455a-9da3-fae6e16c6697 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:13.111910 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-ef2c8e90-6537-455a-9da3-fae6e16c6697 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:13.113393 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-ef2c8e90-6537-455a-9da3-fae6e16c6697 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:13.114712 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-ef2c8e90-6537-455a-9da3-fae6e16c6697 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:13.206895 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-ef2c8e90-6537-455a-9da3-fae6e16c6697 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] 10.222.0.30 "POST /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0/action" status: 200 len: 23219 microversion: 2.20 time: 0.113391 Dec 24 10:46:13.207643 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 98/207] 10.222.0.30 () {62 vars in 1318 bytes} [Fri Dec 24 10:46:13 2021] POST /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0/action => generated 23219 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 24 10:46:13.441262 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-bcdcf6fe-385c-4415-a821-f5c1861beb33 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:46:13.443345 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-bcdcf6fe-385c-4415-a821-f5c1861beb33 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] [instance: c2c661f2-d3da-4357-a7a8-3f85fc94cc60] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:46:13.451940 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-bcdcf6fe-385c-4415-a821-f5c1861beb33 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:13.452400 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-bcdcf6fe-385c-4415-a821-f5c1861beb33 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:13.453269 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-bcdcf6fe-385c-4415-a821-f5c1861beb33 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:13.453718 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-bcdcf6fe-385c-4415-a821-f5c1861beb33 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:13.592501 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-bcdcf6fe-385c-4415-a821-f5c1861beb33 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d627b760f74f48ac560e2ce2e74e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '378bb44ad89440e49f7e290a5d31004e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:46:13.600540 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-bcdcf6fe-385c-4415-a821-f5c1861beb33 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] 10.222.0.30 "GET /compute/v2.1/servers/c2c661f2-d3da-4357-a7a8-3f85fc94cc60" status: 200 len: 1522 microversion: 2.1 time: 0.162966 Dec 24 10:46:13.608963 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 110/208] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:46:13 2021] GET /compute/v2.1/servers/c2c661f2-d3da-4357-a7a8-3f85fc94cc60 => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:46:13.727470 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-e44d02ec-3067-4428-8326-307b6fb61729 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:46:13.728786 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-e44d02ec-3067-4428-8326-307b6fb61729 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] [instance: 6427d66b-d1b3-4cc1-ba3e-f8a8c479189c] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:46:13.735842 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-e44d02ec-3067-4428-8326-307b6fb61729 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:13.736294 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-e44d02ec-3067-4428-8326-307b6fb61729 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:13.737108 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-e44d02ec-3067-4428-8326-307b6fb61729 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:13.737713 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-e44d02ec-3067-4428-8326-307b6fb61729 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:13.810488 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-e44d02ec-3067-4428-8326-307b6fb61729 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ad5096717dc425c849dfe95ea55a6af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62d11172cdf4959a15ac1ffc5601aca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:46:13.822131 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-e44d02ec-3067-4428-8326-307b6fb61729 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] 10.222.0.30 "GET /compute/v2.1/servers/6427d66b-d1b3-4cc1-ba3e-f8a8c479189c" status: 200 len: 1222 microversion: 2.1 time: 0.102378 Dec 24 10:46:13.823020 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 99/209] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:46:13 2021] GET /compute/v2.1/servers/6427d66b-d1b3-4cc1-ba3e-f8a8c479189c => generated 1222 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 24 10:46:14.171284 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-dbf14d9f-ef41-4712-baef-cc54b1c2e8c8 tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:46:14.171988 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-dbf14d9f-ef41-4712-baef-cc54b1c2e8c8 tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] [instance: f77538c5-1e85-4d4f-b6cb-1c003149fac1] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:46:14.178715 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-dbf14d9f-ef41-4712-baef-cc54b1c2e8c8 tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:14.179224 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-dbf14d9f-ef41-4712-baef-cc54b1c2e8c8 tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:14.180057 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-dbf14d9f-ef41-4712-baef-cc54b1c2e8c8 tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:14.180553 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-dbf14d9f-ef41-4712-baef-cc54b1c2e8c8 tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:14.196603 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.wsgi [None req-dbf14d9f-ef41-4712-baef-cc54b1c2e8c8 tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] HTTP exception thrown: Instance f77538c5-1e85-4d4f-b6cb-1c003149fac1 could not be found. Dec 24 10:46:14.197630 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-dbf14d9f-ef41-4712-baef-cc54b1c2e8c8 tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] Returning 404 to user: Instance f77538c5-1e85-4d4f-b6cb-1c003149fac1 could not be found. {{(pid=123431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 24 10:46:14.198189 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-dbf14d9f-ef41-4712-baef-cc54b1c2e8c8 tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] 10.222.0.30 "DELETE /compute/v2.1/servers/f77538c5-1e85-4d4f-b6cb-1c003149fac1" status: 404 len: 111 microversion: 2.1 time: 0.030653 Dec 24 10:46:14.198765 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 111/210] 10.222.0.30 () {58 vars in 1238 bytes} [Fri Dec 24 10:46:14 2021] DELETE /compute/v2.1/servers/f77538c5-1e85-4d4f-b6cb-1c003149fac1 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 24 10:46:14.206698 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-25ec820f-2812-448e-a6df-3ecc2a807cf0 tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:46:14.207288 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-25ec820f-2812-448e-a6df-3ecc2a807cf0 tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] [instance: f77538c5-1e85-4d4f-b6cb-1c003149fac1] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:46:14.214067 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-25ec820f-2812-448e-a6df-3ecc2a807cf0 tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:14.214697 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-25ec820f-2812-448e-a6df-3ecc2a807cf0 tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:14.215786 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-25ec820f-2812-448e-a6df-3ecc2a807cf0 tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:14.215909 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-25ec820f-2812-448e-a6df-3ecc2a807cf0 tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:14.219100 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-ffc2c68a-e217-430e-a769-b65c53afc317 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:46:14.220072 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-ffc2c68a-e217-430e-a769-b65c53afc317 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] [instance: a99a6a98-4010-4f8e-a83f-fcc490f6ece0] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:46:14.226458 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-ffc2c68a-e217-430e-a769-b65c53afc317 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:14.226939 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-ffc2c68a-e217-430e-a769-b65c53afc317 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:14.227997 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-ffc2c68a-e217-430e-a769-b65c53afc317 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:14.228428 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-ffc2c68a-e217-430e-a769-b65c53afc317 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:14.229675 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.wsgi [None req-25ec820f-2812-448e-a6df-3ecc2a807cf0 tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] HTTP exception thrown: Instance f77538c5-1e85-4d4f-b6cb-1c003149fac1 could not be found. Dec 24 10:46:14.230258 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-25ec820f-2812-448e-a6df-3ecc2a807cf0 tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] Returning 404 to user: Instance f77538c5-1e85-4d4f-b6cb-1c003149fac1 could not be found. {{(pid=123432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 24 10:46:14.231066 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-25ec820f-2812-448e-a6df-3ecc2a807cf0 tempest-DeleteServersTestJSON-1129851087 tempest-DeleteServersTestJSON-1129851087-project] 10.222.0.30 "GET /compute/v2.1/servers/f77538c5-1e85-4d4f-b6cb-1c003149fac1" status: 404 len: 111 microversion: 2.1 time: 0.028117 Dec 24 10:46:14.231603 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 100/211] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:46:14 2021] GET /compute/v2.1/servers/f77538c5-1e85-4d4f-b6cb-1c003149fac1 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 24 10:46:14.321904 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-ffc2c68a-e217-430e-a769-b65c53afc317 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] 10.222.0.30 "POST /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0/action" status: 200 len: 23795 microversion: 2.20 time: 0.107216 Dec 24 10:46:14.322784 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 112/212] 10.222.0.30 () {62 vars in 1318 bytes} [Fri Dec 24 10:46:14 2021] POST /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0/action => generated 23795 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 24 10:46:14.617405 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-a8312286-82f8-4118-ae53-11f571a2f667 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:46:14.618272 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-a8312286-82f8-4118-ae53-11f571a2f667 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] [instance: c2c661f2-d3da-4357-a7a8-3f85fc94cc60] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:46:14.624556 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-a8312286-82f8-4118-ae53-11f571a2f667 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:14.625250 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-a8312286-82f8-4118-ae53-11f571a2f667 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:14.626234 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-a8312286-82f8-4118-ae53-11f571a2f667 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:14.626896 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-a8312286-82f8-4118-ae53-11f571a2f667 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:14.766400 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-a8312286-82f8-4118-ae53-11f571a2f667 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d627b760f74f48ac560e2ce2e74e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '378bb44ad89440e49f7e290a5d31004e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:46:14.776218 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-a8312286-82f8-4118-ae53-11f571a2f667 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] 10.222.0.30 "GET /compute/v2.1/servers/c2c661f2-d3da-4357-a7a8-3f85fc94cc60" status: 200 len: 1522 microversion: 2.1 time: 0.162532 Dec 24 10:46:14.777883 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 101/213] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:46:14 2021] GET /compute/v2.1/servers/c2c661f2-d3da-4357-a7a8-3f85fc94cc60 => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:46:14.842506 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-817ac481-c7d7-4719-ad05-66a4d375a68f tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:46:14.843518 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-817ac481-c7d7-4719-ad05-66a4d375a68f tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] [instance: 6427d66b-d1b3-4cc1-ba3e-f8a8c479189c] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:46:14.852279 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-817ac481-c7d7-4719-ad05-66a4d375a68f tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:14.852854 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-817ac481-c7d7-4719-ad05-66a4d375a68f tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:14.853640 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-817ac481-c7d7-4719-ad05-66a4d375a68f tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:14.854071 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-817ac481-c7d7-4719-ad05-66a4d375a68f tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:14.915472 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-817ac481-c7d7-4719-ad05-66a4d375a68f tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ad5096717dc425c849dfe95ea55a6af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62d11172cdf4959a15ac1ffc5601aca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:46:14.927946 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-817ac481-c7d7-4719-ad05-66a4d375a68f tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] 10.222.0.30 "GET /compute/v2.1/servers/6427d66b-d1b3-4cc1-ba3e-f8a8c479189c" status: 200 len: 1270 microversion: 2.1 time: 0.091433 Dec 24 10:46:14.928857 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 113/214] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:46:14 2021] GET /compute/v2.1/servers/6427d66b-d1b3-4cc1-ba3e-f8a8c479189c => generated 1270 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:46:15.337032 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-ca9e21d6-a1a6-4359-b44e-266cc4f0b4d4 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:46:15.338322 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-ca9e21d6-a1a6-4359-b44e-266cc4f0b4d4 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] [instance: a99a6a98-4010-4f8e-a83f-fcc490f6ece0] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:46:15.348871 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-ca9e21d6-a1a6-4359-b44e-266cc4f0b4d4 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:15.349410 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-ca9e21d6-a1a6-4359-b44e-266cc4f0b4d4 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:15.350285 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-ca9e21d6-a1a6-4359-b44e-266cc4f0b4d4 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:15.351559 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-ca9e21d6-a1a6-4359-b44e-266cc4f0b4d4 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:15.444603 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-ca9e21d6-a1a6-4359-b44e-266cc4f0b4d4 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] 10.222.0.30 "POST /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0/action" status: 200 len: 24863 microversion: 2.20 time: 0.112800 Dec 24 10:46:15.445661 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 102/215] 10.222.0.30 () {62 vars in 1318 bytes} [Fri Dec 24 10:46:15 2021] POST /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0/action => generated 24863 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 24 10:46:15.794254 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-6d906377-9349-4a10-9537-2bd1dd0b2574 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:46:15.795120 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-6d906377-9349-4a10-9537-2bd1dd0b2574 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] [instance: c2c661f2-d3da-4357-a7a8-3f85fc94cc60] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:46:15.803265 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-6d906377-9349-4a10-9537-2bd1dd0b2574 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:15.803973 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-6d906377-9349-4a10-9537-2bd1dd0b2574 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:15.805042 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-6d906377-9349-4a10-9537-2bd1dd0b2574 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:15.805709 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-6d906377-9349-4a10-9537-2bd1dd0b2574 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:15.946888 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-ad2903dc-3168-448c-8cba-fe291c51e4e9 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:46:15.947869 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-ad2903dc-3168-448c-8cba-fe291c51e4e9 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] [instance: 6427d66b-d1b3-4cc1-ba3e-f8a8c479189c] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:46:15.956626 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-ad2903dc-3168-448c-8cba-fe291c51e4e9 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:15.961769 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-ad2903dc-3168-448c-8cba-fe291c51e4e9 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:15.962946 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-ad2903dc-3168-448c-8cba-fe291c51e4e9 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:15.963532 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-ad2903dc-3168-448c-8cba-fe291c51e4e9 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:15.999986 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-6d906377-9349-4a10-9537-2bd1dd0b2574 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d627b760f74f48ac560e2ce2e74e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '378bb44ad89440e49f7e290a5d31004e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:46:16.014082 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-6d906377-9349-4a10-9537-2bd1dd0b2574 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] 10.222.0.30 "GET /compute/v2.1/servers/c2c661f2-d3da-4357-a7a8-3f85fc94cc60" status: 200 len: 1522 microversion: 2.1 time: 0.221313 Dec 24 10:46:16.024592 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 114/216] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:46:15 2021] GET /compute/v2.1/servers/c2c661f2-d3da-4357-a7a8-3f85fc94cc60 => generated 1522 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:46:16.119358 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-ad2903dc-3168-448c-8cba-fe291c51e4e9 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ad5096717dc425c849dfe95ea55a6af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62d11172cdf4959a15ac1ffc5601aca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:46:16.128148 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-ad2903dc-3168-448c-8cba-fe291c51e4e9 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] 10.222.0.30 "GET /compute/v2.1/servers/6427d66b-d1b3-4cc1-ba3e-f8a8c479189c" status: 200 len: 1276 microversion: 2.1 time: 0.185997 Dec 24 10:46:16.132795 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 103/217] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:46:15 2021] GET /compute/v2.1/servers/6427d66b-d1b3-4cc1-ba3e-f8a8c479189c => generated 1276 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:46:16.460555 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-0d5945b4-22bc-4812-8d69-55cc9b73ef23 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:46:16.462551 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-0d5945b4-22bc-4812-8d69-55cc9b73ef23 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] [instance: a99a6a98-4010-4f8e-a83f-fcc490f6ece0] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:46:16.483242 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-0d5945b4-22bc-4812-8d69-55cc9b73ef23 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:16.484115 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-0d5945b4-22bc-4812-8d69-55cc9b73ef23 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:16.485279 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-0d5945b4-22bc-4812-8d69-55cc9b73ef23 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:16.485989 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-0d5945b4-22bc-4812-8d69-55cc9b73ef23 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:16.595812 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-0d5945b4-22bc-4812-8d69-55cc9b73ef23 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] 10.222.0.30 "POST /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0/action" status: 200 len: 25404 microversion: 2.20 time: 0.143426 Dec 24 10:46:16.599195 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 115/218] 10.222.0.30 () {62 vars in 1318 bytes} [Fri Dec 24 10:46:16 2021] POST /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0/action => generated 25404 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 24 10:46:17.031125 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-147db4c5-39e4-44a8-8a0b-a38fa7bfe9d6 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:46:17.032723 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-147db4c5-39e4-44a8-8a0b-a38fa7bfe9d6 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] [instance: c2c661f2-d3da-4357-a7a8-3f85fc94cc60] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:46:17.040578 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-147db4c5-39e4-44a8-8a0b-a38fa7bfe9d6 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:17.041262 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-147db4c5-39e4-44a8-8a0b-a38fa7bfe9d6 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:17.043025 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-147db4c5-39e4-44a8-8a0b-a38fa7bfe9d6 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:17.043608 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-147db4c5-39e4-44a8-8a0b-a38fa7bfe9d6 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:17.151961 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-f9712386-109b-42b6-ae59-3a08783c90ec tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:46:17.154539 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-f9712386-109b-42b6-ae59-3a08783c90ec tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] [instance: 6427d66b-d1b3-4cc1-ba3e-f8a8c479189c] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:46:17.179813 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-f9712386-109b-42b6-ae59-3a08783c90ec tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:17.179813 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-f9712386-109b-42b6-ae59-3a08783c90ec tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:17.179813 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-f9712386-109b-42b6-ae59-3a08783c90ec tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:17.179813 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-f9712386-109b-42b6-ae59-3a08783c90ec tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:17.413416 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-147db4c5-39e4-44a8-8a0b-a38fa7bfe9d6 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d627b760f74f48ac560e2ce2e74e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '378bb44ad89440e49f7e290a5d31004e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:46:17.423460 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-147db4c5-39e4-44a8-8a0b-a38fa7bfe9d6 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] 10.222.0.30 "GET /compute/v2.1/servers/c2c661f2-d3da-4357-a7a8-3f85fc94cc60" status: 200 len: 1522 microversion: 2.1 time: 0.396925 Dec 24 10:46:17.424623 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 104/219] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:46:17 2021] GET /compute/v2.1/servers/c2c661f2-d3da-4357-a7a8-3f85fc94cc60 => generated 1522 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:46:17.470832 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-f9712386-109b-42b6-ae59-3a08783c90ec tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ad5096717dc425c849dfe95ea55a6af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62d11172cdf4959a15ac1ffc5601aca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:46:17.485815 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-f9712386-109b-42b6-ae59-3a08783c90ec tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] 10.222.0.30 "GET /compute/v2.1/servers/6427d66b-d1b3-4cc1-ba3e-f8a8c479189c" status: 200 len: 1318 microversion: 2.1 time: 0.339524 Dec 24 10:46:17.485815 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 116/220] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:46:17 2021] GET /compute/v2.1/servers/6427d66b-d1b3-4cc1-ba3e-f8a8c479189c => generated 1318 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:46:17.609078 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-92b17e65-5be1-4b80-af2a-c3e3d7ede907 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:46:17.612418 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-92b17e65-5be1-4b80-af2a-c3e3d7ede907 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] [instance: a99a6a98-4010-4f8e-a83f-fcc490f6ece0] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:46:17.617652 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-92b17e65-5be1-4b80-af2a-c3e3d7ede907 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:17.618108 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-92b17e65-5be1-4b80-af2a-c3e3d7ede907 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:17.618912 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-92b17e65-5be1-4b80-af2a-c3e3d7ede907 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:17.619689 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-92b17e65-5be1-4b80-af2a-c3e3d7ede907 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:17.667369 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [req-51198136-8085-4629-bfa3-8eff14a9044f req-814e93cc-7e0a-4e3d-be9a-e12702637b0c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6427d66b-d1b3-4cc1-ba3e-f8a8c479189c", "tag": "d90cd231-c375-419c-945c-fe78bf0f2cf4"}]} {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:46:17.669366 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 10:46:17.669366 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: warnings.warn(msg) Dec 24 10:46:17.691183 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [req-51198136-8085-4629-bfa3-8eff14a9044f req-814e93cc-7e0a-4e3d-be9a-e12702637b0c service nova] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:17.694974 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [req-51198136-8085-4629-bfa3-8eff14a9044f req-814e93cc-7e0a-4e3d-be9a-e12702637b0c service nova] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:17.713875 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.compute.server_external_events [req-51198136-8085-4629-bfa3-8eff14a9044f req-814e93cc-7e0a-4e3d-be9a-e12702637b0c service nova] Creating event network-changed:d90cd231-c375-419c-945c-fe78bf0f2cf4 for instance 6427d66b-d1b3-4cc1-ba3e-f8a8c479189c on hv-cinder-81644 Dec 24 10:46:17.720072 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [req-51198136-8085-4629-bfa3-8eff14a9044f req-814e93cc-7e0a-4e3d-be9a-e12702637b0c service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058318 Dec 24 10:46:17.720684 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 117/221] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Dec 24 10:46:17 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 10:46:17.751595 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-92b17e65-5be1-4b80-af2a-c3e3d7ede907 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] 10.222.0.30 "POST /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0/action" status: 200 len: 26242 microversion: 2.20 time: 0.146420 Dec 24 10:46:17.753031 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 105/222] 10.222.0.30 () {62 vars in 1318 bytes} [Fri Dec 24 10:46:17 2021] POST /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0/action => generated 26242 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 24 10:46:18.455172 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-09f61b5b-8531-4928-9493-e3efba34e2fe tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:46:18.456559 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-09f61b5b-8531-4928-9493-e3efba34e2fe tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] [instance: c2c661f2-d3da-4357-a7a8-3f85fc94cc60] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:46:18.465759 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-09f61b5b-8531-4928-9493-e3efba34e2fe tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:18.466700 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-09f61b5b-8531-4928-9493-e3efba34e2fe tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:18.467637 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-09f61b5b-8531-4928-9493-e3efba34e2fe tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:18.468292 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-09f61b5b-8531-4928-9493-e3efba34e2fe tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:18.501537 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-52e3f5b1-d8e7-4cae-b128-638d8c88433d tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:46:18.502879 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-52e3f5b1-d8e7-4cae-b128-638d8c88433d tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] [instance: 6427d66b-d1b3-4cc1-ba3e-f8a8c479189c] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:46:18.510726 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-52e3f5b1-d8e7-4cae-b128-638d8c88433d tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:18.511468 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-52e3f5b1-d8e7-4cae-b128-638d8c88433d tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:18.512518 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-52e3f5b1-d8e7-4cae-b128-638d8c88433d tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:18.513209 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-52e3f5b1-d8e7-4cae-b128-638d8c88433d tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:18.776473 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-09f61b5b-8531-4928-9493-e3efba34e2fe tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d627b760f74f48ac560e2ce2e74e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '378bb44ad89440e49f7e290a5d31004e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:46:18.782284 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-52e3f5b1-d8e7-4cae-b128-638d8c88433d tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ad5096717dc425c849dfe95ea55a6af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62d11172cdf4959a15ac1ffc5601aca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:46:18.784219 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-09f61b5b-8531-4928-9493-e3efba34e2fe tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] 10.222.0.30 "GET /compute/v2.1/servers/c2c661f2-d3da-4357-a7a8-3f85fc94cc60" status: 200 len: 1522 microversion: 2.1 time: 0.342864 Dec 24 10:46:18.784997 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 118/223] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:46:18 2021] GET /compute/v2.1/servers/c2c661f2-d3da-4357-a7a8-3f85fc94cc60 => generated 1522 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:46:18.794001 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-52e3f5b1-d8e7-4cae-b128-638d8c88433d tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] 10.222.0.30 "GET /compute/v2.1/servers/6427d66b-d1b3-4cc1-ba3e-f8a8c479189c" status: 200 len: 1318 microversion: 2.1 time: 0.296397 Dec 24 10:46:18.796231 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 106/224] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:46:18 2021] GET /compute/v2.1/servers/6427d66b-d1b3-4cc1-ba3e-f8a8c479189c => generated 1318 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:46:18.797855 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-8d919069-e4c8-4d45-acac-687c34bc250d tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:46:18.798871 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-8d919069-e4c8-4d45-acac-687c34bc250d tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] [instance: a99a6a98-4010-4f8e-a83f-fcc490f6ece0] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:46:18.810864 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-8d919069-e4c8-4d45-acac-687c34bc250d tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:18.811316 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-8d919069-e4c8-4d45-acac-687c34bc250d tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:18.823730 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-8d919069-e4c8-4d45-acac-687c34bc250d tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:18.823730 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-8d919069-e4c8-4d45-acac-687c34bc250d tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:18.922476 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-8d919069-e4c8-4d45-acac-687c34bc250d tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] 10.222.0.30 "POST /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0/action" status: 200 len: 27039 microversion: 2.20 time: 0.136025 Dec 24 10:46:18.923126 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 119/225] 10.222.0.30 () {62 vars in 1318 bytes} [Fri Dec 24 10:46:18 2021] POST /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0/action => generated 27039 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 24 10:46:19.801201 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-daf8e8ad-a76d-4af8-9356-c568e0addf1f tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:46:19.801804 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-daf8e8ad-a76d-4af8-9356-c568e0addf1f tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] [instance: c2c661f2-d3da-4357-a7a8-3f85fc94cc60] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:46:19.807916 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-daf8e8ad-a76d-4af8-9356-c568e0addf1f tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:19.808343 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-daf8e8ad-a76d-4af8-9356-c568e0addf1f tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:19.809140 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-daf8e8ad-a76d-4af8-9356-c568e0addf1f tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:19.809617 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-daf8e8ad-a76d-4af8-9356-c568e0addf1f tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:19.813002 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-277c7266-a35a-45bd-b091-c7f03375d598 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:46:19.813697 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-277c7266-a35a-45bd-b091-c7f03375d598 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] [instance: 6427d66b-d1b3-4cc1-ba3e-f8a8c479189c] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:46:19.821186 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-277c7266-a35a-45bd-b091-c7f03375d598 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:19.821637 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-277c7266-a35a-45bd-b091-c7f03375d598 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:19.822417 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-277c7266-a35a-45bd-b091-c7f03375d598 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:19.822850 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-277c7266-a35a-45bd-b091-c7f03375d598 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:19.983375 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-277c7266-a35a-45bd-b091-c7f03375d598 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ad5096717dc425c849dfe95ea55a6af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62d11172cdf4959a15ac1ffc5601aca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:46:19.984470 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-daf8e8ad-a76d-4af8-9356-c568e0addf1f tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d627b760f74f48ac560e2ce2e74e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '378bb44ad89440e49f7e290a5d31004e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:46:19.993937 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-daf8e8ad-a76d-4af8-9356-c568e0addf1f tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] 10.222.0.30 "GET /compute/v2.1/servers/c2c661f2-d3da-4357-a7a8-3f85fc94cc60" status: 200 len: 1522 microversion: 2.1 time: 0.196527 Dec 24 10:46:19.994528 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 107/226] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:46:19 2021] GET /compute/v2.1/servers/c2c661f2-d3da-4357-a7a8-3f85fc94cc60 => generated 1522 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:46:20.006143 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-53127f6b-37ff-4390-bb95-bc2847f60458 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:46:20.007029 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-53127f6b-37ff-4390-bb95-bc2847f60458 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] [instance: a99a6a98-4010-4f8e-a83f-fcc490f6ece0] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:46:20.007877 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-277c7266-a35a-45bd-b091-c7f03375d598 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] 10.222.0.30 "GET /compute/v2.1/servers/6427d66b-d1b3-4cc1-ba3e-f8a8c479189c" status: 200 len: 1318 microversion: 2.1 time: 0.197535 Dec 24 10:46:20.009533 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 120/227] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:46:19 2021] GET /compute/v2.1/servers/6427d66b-d1b3-4cc1-ba3e-f8a8c479189c => generated 1318 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 24 10:46:20.036973 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-53127f6b-37ff-4390-bb95-bc2847f60458 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:20.037429 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-53127f6b-37ff-4390-bb95-bc2847f60458 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:20.038367 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-53127f6b-37ff-4390-bb95-bc2847f60458 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:20.038807 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-53127f6b-37ff-4390-bb95-bc2847f60458 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:20.165714 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-53127f6b-37ff-4390-bb95-bc2847f60458 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] 10.222.0.30 "POST /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0/action" status: 200 len: 27366 microversion: 2.20 time: 0.169931 Dec 24 10:46:20.166958 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 108/228] 10.222.0.30 () {62 vars in 1318 bytes} [Fri Dec 24 10:46:19 2021] POST /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0/action => generated 27366 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 24 10:46:21.011426 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-4b204d10-c45a-495a-ac8e-e00029812f63 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:46:21.012070 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-4b204d10-c45a-495a-ac8e-e00029812f63 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] [instance: c2c661f2-d3da-4357-a7a8-3f85fc94cc60] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:46:21.026875 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-4b204d10-c45a-495a-ac8e-e00029812f63 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:21.027276 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-5732305a-e2c3-4850-9a48-286421768a70 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:46:21.028943 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-4b204d10-c45a-495a-ac8e-e00029812f63 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:21.029076 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-5732305a-e2c3-4850-9a48-286421768a70 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] [instance: 6427d66b-d1b3-4cc1-ba3e-f8a8c479189c] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:46:21.030948 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-4b204d10-c45a-495a-ac8e-e00029812f63 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:21.032373 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-4b204d10-c45a-495a-ac8e-e00029812f63 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:21.039993 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-5732305a-e2c3-4850-9a48-286421768a70 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:21.056304 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-5732305a-e2c3-4850-9a48-286421768a70 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:21.056304 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-5732305a-e2c3-4850-9a48-286421768a70 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:21.056304 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-5732305a-e2c3-4850-9a48-286421768a70 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:21.249617 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-5732305a-e2c3-4850-9a48-286421768a70 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ad5096717dc425c849dfe95ea55a6af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62d11172cdf4959a15ac1ffc5601aca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:46:21.266899 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-5732305a-e2c3-4850-9a48-286421768a70 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] 10.222.0.30 "GET /compute/v2.1/servers/6427d66b-d1b3-4cc1-ba3e-f8a8c479189c" status: 200 len: 1318 microversion: 2.1 time: 0.243675 Dec 24 10:46:21.269354 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 109/229] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:46:21 2021] GET /compute/v2.1/servers/6427d66b-d1b3-4cc1-ba3e-f8a8c479189c => generated 1318 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 24 10:46:21.275557 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-bd5a4159-d0de-4cf0-b76b-79b8b113f539 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:46:21.276568 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-bd5a4159-d0de-4cf0-b76b-79b8b113f539 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] [instance: a99a6a98-4010-4f8e-a83f-fcc490f6ece0] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:46:21.298519 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-bd5a4159-d0de-4cf0-b76b-79b8b113f539 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:21.303548 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-bd5a4159-d0de-4cf0-b76b-79b8b113f539 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:21.304705 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-bd5a4159-d0de-4cf0-b76b-79b8b113f539 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:21.305687 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-bd5a4159-d0de-4cf0-b76b-79b8b113f539 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:21.361487 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-4b204d10-c45a-495a-ac8e-e00029812f63 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d627b760f74f48ac560e2ce2e74e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '378bb44ad89440e49f7e290a5d31004e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:46:21.375599 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-4b204d10-c45a-495a-ac8e-e00029812f63 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] 10.222.0.30 "GET /compute/v2.1/servers/c2c661f2-d3da-4357-a7a8-3f85fc94cc60" status: 200 len: 1522 microversion: 2.1 time: 0.368541 Dec 24 10:46:21.387463 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 121/230] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:46:21 2021] GET /compute/v2.1/servers/c2c661f2-d3da-4357-a7a8-3f85fc94cc60 => generated 1522 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:46:22.287366 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-d639e84e-062b-4cec-873b-a789a1de7376 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:46:22.287960 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-d639e84e-062b-4cec-873b-a789a1de7376 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] [instance: 6427d66b-d1b3-4cc1-ba3e-f8a8c479189c] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:46:22.299475 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-d639e84e-062b-4cec-873b-a789a1de7376 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:22.302156 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-d639e84e-062b-4cec-873b-a789a1de7376 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:22.302156 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-d639e84e-062b-4cec-873b-a789a1de7376 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:22.302156 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-d639e84e-062b-4cec-873b-a789a1de7376 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:22.580742 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-d639e84e-062b-4cec-873b-a789a1de7376 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ad5096717dc425c849dfe95ea55a6af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62d11172cdf4959a15ac1ffc5601aca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:46:22.588459 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-d639e84e-062b-4cec-873b-a789a1de7376 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] 10.222.0.30 "GET /compute/v2.1/servers/6427d66b-d1b3-4cc1-ba3e-f8a8c479189c" status: 200 len: 1318 microversion: 2.1 time: 0.305120 Dec 24 10:46:22.593895 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 122/231] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:46:22 2021] GET /compute/v2.1/servers/6427d66b-d1b3-4cc1-ba3e-f8a8c479189c => generated 1318 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 24 10:46:22.599099 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-4e657f68-0156-4325-a0cb-ae63748b5107 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:46:22.599763 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-4e657f68-0156-4325-a0cb-ae63748b5107 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] [instance: c2c661f2-d3da-4357-a7a8-3f85fc94cc60] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:46:22.610444 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-4e657f68-0156-4325-a0cb-ae63748b5107 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:22.611013 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-4e657f68-0156-4325-a0cb-ae63748b5107 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:22.611874 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-4e657f68-0156-4325-a0cb-ae63748b5107 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:22.612527 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-4e657f68-0156-4325-a0cb-ae63748b5107 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:22.960188 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-4e657f68-0156-4325-a0cb-ae63748b5107 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d627b760f74f48ac560e2ce2e74e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '378bb44ad89440e49f7e290a5d31004e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:46:22.969178 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-4e657f68-0156-4325-a0cb-ae63748b5107 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] 10.222.0.30 "GET /compute/v2.1/servers/c2c661f2-d3da-4357-a7a8-3f85fc94cc60" status: 200 len: 1522 microversion: 2.1 time: 0.374069 Dec 24 10:46:22.969748 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 123/232] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:46:22 2021] GET /compute/v2.1/servers/c2c661f2-d3da-4357-a7a8-3f85fc94cc60 => generated 1522 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:46:23.611110 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-490bad86-8746-4c85-983a-c68d7fd07337 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:46:23.612799 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-490bad86-8746-4c85-983a-c68d7fd07337 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] [instance: 6427d66b-d1b3-4cc1-ba3e-f8a8c479189c] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:46:23.620797 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-490bad86-8746-4c85-983a-c68d7fd07337 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:23.621481 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-490bad86-8746-4c85-983a-c68d7fd07337 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:23.622490 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-490bad86-8746-4c85-983a-c68d7fd07337 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:23.622973 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-490bad86-8746-4c85-983a-c68d7fd07337 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:23.734324 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-bd5a4159-d0de-4cf0-b76b-79b8b113f539 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] 10.222.0.30 "POST /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0/action" status: 200 len: 27795 microversion: 2.20 time: 2.449145 Dec 24 10:46:23.734324 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 110/233] 10.222.0.30 () {62 vars in 1318 bytes} [Fri Dec 24 10:46:21 2021] POST /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0/action => generated 27795 bytes in 2459 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 24 10:46:23.926684 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-490bad86-8746-4c85-983a-c68d7fd07337 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ad5096717dc425c849dfe95ea55a6af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62d11172cdf4959a15ac1ffc5601aca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:46:23.937784 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-490bad86-8746-4c85-983a-c68d7fd07337 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] 10.222.0.30 "GET /compute/v2.1/servers/6427d66b-d1b3-4cc1-ba3e-f8a8c479189c" status: 200 len: 1318 microversion: 2.1 time: 0.330204 Dec 24 10:46:23.939128 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 124/234] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:46:23 2021] GET /compute/v2.1/servers/6427d66b-d1b3-4cc1-ba3e-f8a8c479189c => generated 1318 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 24 10:46:23.990171 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-f164d0e1-7368-468a-bd70-b66f5c37118a tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:46:23.991322 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-f164d0e1-7368-468a-bd70-b66f5c37118a tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] [instance: c2c661f2-d3da-4357-a7a8-3f85fc94cc60] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:46:24.001109 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-f164d0e1-7368-468a-bd70-b66f5c37118a tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:24.009531 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-f164d0e1-7368-468a-bd70-b66f5c37118a tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:24.009531 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-f164d0e1-7368-468a-bd70-b66f5c37118a tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:24.009531 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-f164d0e1-7368-468a-bd70-b66f5c37118a tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:24.163912 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-f164d0e1-7368-468a-bd70-b66f5c37118a tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d627b760f74f48ac560e2ce2e74e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '378bb44ad89440e49f7e290a5d31004e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:46:24.174874 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-f164d0e1-7368-468a-bd70-b66f5c37118a tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] 10.222.0.30 "GET /compute/v2.1/servers/c2c661f2-d3da-4357-a7a8-3f85fc94cc60" status: 200 len: 1522 microversion: 2.1 time: 0.192764 Dec 24 10:46:24.175568 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 111/235] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:46:23 2021] GET /compute/v2.1/servers/c2c661f2-d3da-4357-a7a8-3f85fc94cc60 => generated 1522 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:46:24.746198 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-ee8028fc-ede4-42b2-b4cb-5f25b3834b3a tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:46:24.747260 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-ee8028fc-ede4-42b2-b4cb-5f25b3834b3a tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] [instance: a99a6a98-4010-4f8e-a83f-fcc490f6ece0] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:46:24.755530 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-ee8028fc-ede4-42b2-b4cb-5f25b3834b3a tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:24.756275 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-ee8028fc-ede4-42b2-b4cb-5f25b3834b3a tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:24.757096 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-ee8028fc-ede4-42b2-b4cb-5f25b3834b3a tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:24.757525 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-ee8028fc-ede4-42b2-b4cb-5f25b3834b3a tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:24.860394 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-ee8028fc-ede4-42b2-b4cb-5f25b3834b3a tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] 10.222.0.30 "POST /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0/action" status: 200 len: 28157 microversion: 2.20 time: 0.119736 Dec 24 10:46:24.864859 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 125/236] 10.222.0.30 () {62 vars in 1318 bytes} [Fri Dec 24 10:46:24 2021] POST /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0/action => generated 28157 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 24 10:46:24.967769 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-22f1a5b4-506f-487d-bb41-381a1df42d7b tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:46:24.967769 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-22f1a5b4-506f-487d-bb41-381a1df42d7b tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] [instance: 6427d66b-d1b3-4cc1-ba3e-f8a8c479189c] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:46:24.989271 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-22f1a5b4-506f-487d-bb41-381a1df42d7b tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:24.993028 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-22f1a5b4-506f-487d-bb41-381a1df42d7b tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:24.997516 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-22f1a5b4-506f-487d-bb41-381a1df42d7b tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:25.001501 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-22f1a5b4-506f-487d-bb41-381a1df42d7b tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:25.169626 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-22f1a5b4-506f-487d-bb41-381a1df42d7b tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ad5096717dc425c849dfe95ea55a6af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62d11172cdf4959a15ac1ffc5601aca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:46:25.177655 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-22f1a5b4-506f-487d-bb41-381a1df42d7b tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] 10.222.0.30 "GET /compute/v2.1/servers/6427d66b-d1b3-4cc1-ba3e-f8a8c479189c" status: 200 len: 1318 microversion: 2.1 time: 0.226022 Dec 24 10:46:25.178105 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 112/237] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:46:24 2021] GET /compute/v2.1/servers/6427d66b-d1b3-4cc1-ba3e-f8a8c479189c => generated 1318 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:46:25.193031 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-beb1623b-24e1-41c4-94be-d7514135adb1 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:46:25.193907 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-beb1623b-24e1-41c4-94be-d7514135adb1 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] [instance: c2c661f2-d3da-4357-a7a8-3f85fc94cc60] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:46:25.200317 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-beb1623b-24e1-41c4-94be-d7514135adb1 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:25.200947 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-beb1623b-24e1-41c4-94be-d7514135adb1 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:25.201977 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-beb1623b-24e1-41c4-94be-d7514135adb1 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:25.202487 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-beb1623b-24e1-41c4-94be-d7514135adb1 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:25.409557 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-beb1623b-24e1-41c4-94be-d7514135adb1 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d627b760f74f48ac560e2ce2e74e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '378bb44ad89440e49f7e290a5d31004e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:46:25.418062 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-beb1623b-24e1-41c4-94be-d7514135adb1 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] 10.222.0.30 "GET /compute/v2.1/servers/c2c661f2-d3da-4357-a7a8-3f85fc94cc60" status: 200 len: 1522 microversion: 2.1 time: 0.229977 Dec 24 10:46:25.418907 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 126/238] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:46:25 2021] GET /compute/v2.1/servers/c2c661f2-d3da-4357-a7a8-3f85fc94cc60 => generated 1522 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:46:25.874582 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-dd09f40b-3778-4560-8d66-09bf4656469a tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:46:25.876344 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-dd09f40b-3778-4560-8d66-09bf4656469a tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] [instance: a99a6a98-4010-4f8e-a83f-fcc490f6ece0] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:46:25.886964 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-dd09f40b-3778-4560-8d66-09bf4656469a tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:25.888559 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-dd09f40b-3778-4560-8d66-09bf4656469a tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:25.889630 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-dd09f40b-3778-4560-8d66-09bf4656469a tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:25.890257 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-dd09f40b-3778-4560-8d66-09bf4656469a tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:25.964688 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-dd09f40b-3778-4560-8d66-09bf4656469a tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] 10.222.0.30 "POST /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0/action" status: 200 len: 28157 microversion: 2.20 time: 0.094553 Dec 24 10:46:25.971347 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 113/239] 10.222.0.30 () {62 vars in 1318 bytes} [Fri Dec 24 10:46:25 2021] POST /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0/action => generated 28157 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 24 10:46:26.063887 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-b67be0ca-2eaf-4b64-895d-e00f171634a6 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Action: 'create', calling method: .version_select at 0x7f1899e64310>, body: {"keypair": {"name": "tempest-keypair-1861528941"}} {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:46:26.081076 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.quota [None req-b67be0ca-2eaf-4b64-895d-e00f171634a6 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Getting quotas for project 3f0115a5cc8b4b1e8bffb84e0f3e0b08. Resources: {'key_pairs'} {{(pid=123431) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 24 10:46:26.085648 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.quota [None req-b67be0ca-2eaf-4b64-895d-e00f171634a6 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Getting quotas for user 37516225f9244c969ed168f6a024482a and project 3f0115a5cc8b4b1e8bffb84e0f3e0b08. Resources: {'key_pairs'} {{(pid=123431) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 24 10:46:26.194625 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-d20cd8af-e97c-4b7b-b382-f52e0f2e111d tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:46:26.195318 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-d20cd8af-e97c-4b7b-b382-f52e0f2e111d tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] [instance: 6427d66b-d1b3-4cc1-ba3e-f8a8c479189c] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:46:26.202849 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-d20cd8af-e97c-4b7b-b382-f52e0f2e111d tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:26.203298 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-d20cd8af-e97c-4b7b-b382-f52e0f2e111d tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:26.204117 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-d20cd8af-e97c-4b7b-b382-f52e0f2e111d tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:26.204545 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-d20cd8af-e97c-4b7b-b382-f52e0f2e111d tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:26.320938 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.quota [None req-b67be0ca-2eaf-4b64-895d-e00f171634a6 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Getting quotas for project 3f0115a5cc8b4b1e8bffb84e0f3e0b08. Resources: {'key_pairs'} {{(pid=123431) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 24 10:46:26.324946 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.quota [None req-b67be0ca-2eaf-4b64-895d-e00f171634a6 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Getting quotas for user 37516225f9244c969ed168f6a024482a and project 3f0115a5cc8b4b1e8bffb84e0f3e0b08. Resources: {'key_pairs'} {{(pid=123431) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 24 10:46:26.340194 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-b67be0ca-2eaf-4b64-895d-e00f171634a6 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 2305 microversion: 2.1 time: 0.404329 Dec 24 10:46:26.341131 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 127/240] 10.222.0.30 () {60 vars in 1157 bytes} [Fri Dec 24 10:46:25 2021] POST /compute/v2.1/os-keypairs => generated 2305 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:46:26.387140 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-d20cd8af-e97c-4b7b-b382-f52e0f2e111d tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ad5096717dc425c849dfe95ea55a6af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62d11172cdf4959a15ac1ffc5601aca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:46:26.396162 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-d20cd8af-e97c-4b7b-b382-f52e0f2e111d tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] 10.222.0.30 "GET /compute/v2.1/servers/6427d66b-d1b3-4cc1-ba3e-f8a8c479189c" status: 200 len: 1318 microversion: 2.1 time: 0.205575 Dec 24 10:46:26.397125 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 114/241] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:46:26 2021] GET /compute/v2.1/servers/6427d66b-d1b3-4cc1-ba3e-f8a8c479189c => generated 1318 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 24 10:46:26.435423 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-71ddc85c-defa-4cd5-8d7f-61ff50a8b7fc tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:46:26.436210 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-71ddc85c-defa-4cd5-8d7f-61ff50a8b7fc tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] [instance: c2c661f2-d3da-4357-a7a8-3f85fc94cc60] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:46:26.442866 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-71ddc85c-defa-4cd5-8d7f-61ff50a8b7fc tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:26.443388 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-71ddc85c-defa-4cd5-8d7f-61ff50a8b7fc tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:26.444249 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-71ddc85c-defa-4cd5-8d7f-61ff50a8b7fc tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:26.444772 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-71ddc85c-defa-4cd5-8d7f-61ff50a8b7fc tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:26.655424 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-71ddc85c-defa-4cd5-8d7f-61ff50a8b7fc tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d627b760f74f48ac560e2ce2e74e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '378bb44ad89440e49f7e290a5d31004e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:46:26.672781 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-71ddc85c-defa-4cd5-8d7f-61ff50a8b7fc tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] 10.222.0.30 "GET /compute/v2.1/servers/c2c661f2-d3da-4357-a7a8-3f85fc94cc60" status: 200 len: 1522 microversion: 2.1 time: 0.241382 Dec 24 10:46:26.675544 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 128/242] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:46:26 2021] GET /compute/v2.1/servers/c2c661f2-d3da-4357-a7a8-3f85fc94cc60 => generated 1522 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:46:26.979655 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-7ee7b564-5e46-42b4-91aa-16c7ed5fb9bf tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:46:26.980582 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-7ee7b564-5e46-42b4-91aa-16c7ed5fb9bf tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] [instance: a99a6a98-4010-4f8e-a83f-fcc490f6ece0] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:46:26.986968 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-7ee7b564-5e46-42b4-91aa-16c7ed5fb9bf tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:26.987611 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-7ee7b564-5e46-42b4-91aa-16c7ed5fb9bf tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:26.988587 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-7ee7b564-5e46-42b4-91aa-16c7ed5fb9bf tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:26.989218 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-7ee7b564-5e46-42b4-91aa-16c7ed5fb9bf tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:27.273903 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [req-2c825dbb-40d2-44aa-87bb-27ad9a413ebb req-333f7882-fc96-4262-a660-f90f69f4acff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6427d66b-d1b3-4cc1-ba3e-f8a8c479189c", "name": "network-vif-plugged", "status": "completed", "tag": "d90cd231-c375-419c-945c-fe78bf0f2cf4"}]} {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:46:27.275527 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 10:46:27.275527 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: warnings.warn(msg) Dec 24 10:46:27.283098 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [req-2c825dbb-40d2-44aa-87bb-27ad9a413ebb req-333f7882-fc96-4262-a660-f90f69f4acff service nova] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:27.289777 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [req-2c825dbb-40d2-44aa-87bb-27ad9a413ebb req-333f7882-fc96-4262-a660-f90f69f4acff service nova] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:27.294499 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.compute.server_external_events [req-2c825dbb-40d2-44aa-87bb-27ad9a413ebb req-333f7882-fc96-4262-a660-f90f69f4acff service nova] Creating event network-vif-plugged:d90cd231-c375-419c-945c-fe78bf0f2cf4 for instance 6427d66b-d1b3-4cc1-ba3e-f8a8c479189c on hv-cinder-81644 Dec 24 10:46:27.299135 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [req-2c825dbb-40d2-44aa-87bb-27ad9a413ebb req-333f7882-fc96-4262-a660-f90f69f4acff service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029216 Dec 24 10:46:27.299729 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 129/243] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Dec 24 10:46:27 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 24 10:46:27.413961 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-73019145-ae91-417f-b412-bb8c45ea26a0 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:46:27.414653 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-73019145-ae91-417f-b412-bb8c45ea26a0 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] [instance: 6427d66b-d1b3-4cc1-ba3e-f8a8c479189c] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:46:27.420920 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-73019145-ae91-417f-b412-bb8c45ea26a0 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:27.421257 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-73019145-ae91-417f-b412-bb8c45ea26a0 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:27.422034 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-73019145-ae91-417f-b412-bb8c45ea26a0 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:27.422466 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-73019145-ae91-417f-b412-bb8c45ea26a0 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:27.578202 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-73019145-ae91-417f-b412-bb8c45ea26a0 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ad5096717dc425c849dfe95ea55a6af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62d11172cdf4959a15ac1ffc5601aca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:46:27.588334 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-73019145-ae91-417f-b412-bb8c45ea26a0 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] 10.222.0.30 "GET /compute/v2.1/servers/6427d66b-d1b3-4cc1-ba3e-f8a8c479189c" status: 200 len: 1318 microversion: 2.1 time: 0.178212 Dec 24 10:46:27.591832 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 130/244] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:46:27 2021] GET /compute/v2.1/servers/6427d66b-d1b3-4cc1-ba3e-f8a8c479189c => generated 1318 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 24 10:46:27.690226 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-d0f7dd51-237e-4d1e-af22-773e17260180 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:46:27.690831 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-d0f7dd51-237e-4d1e-af22-773e17260180 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] [instance: c2c661f2-d3da-4357-a7a8-3f85fc94cc60] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:46:27.699337 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-d0f7dd51-237e-4d1e-af22-773e17260180 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:27.700047 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-d0f7dd51-237e-4d1e-af22-773e17260180 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:27.700959 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-d0f7dd51-237e-4d1e-af22-773e17260180 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:27.701459 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-d0f7dd51-237e-4d1e-af22-773e17260180 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:27.887597 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-d0f7dd51-237e-4d1e-af22-773e17260180 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d627b760f74f48ac560e2ce2e74e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '378bb44ad89440e49f7e290a5d31004e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:46:27.895591 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-d0f7dd51-237e-4d1e-af22-773e17260180 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] 10.222.0.30 "GET /compute/v2.1/servers/c2c661f2-d3da-4357-a7a8-3f85fc94cc60" status: 200 len: 1522 microversion: 2.1 time: 0.209155 Dec 24 10:46:27.899187 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 131/245] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:46:27 2021] GET /compute/v2.1/servers/c2c661f2-d3da-4357-a7a8-3f85fc94cc60 => generated 1522 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 24 10:46:28.610195 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-96df2566-fb86-45a5-93c7-28b1b1ed5fb2 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:46:28.610195 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-96df2566-fb86-45a5-93c7-28b1b1ed5fb2 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] [instance: 6427d66b-d1b3-4cc1-ba3e-f8a8c479189c] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:46:28.616549 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-96df2566-fb86-45a5-93c7-28b1b1ed5fb2 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:28.618344 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-96df2566-fb86-45a5-93c7-28b1b1ed5fb2 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:28.619468 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-96df2566-fb86-45a5-93c7-28b1b1ed5fb2 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:28.620026 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-96df2566-fb86-45a5-93c7-28b1b1ed5fb2 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:28.869662 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-96df2566-fb86-45a5-93c7-28b1b1ed5fb2 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ad5096717dc425c849dfe95ea55a6af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62d11172cdf4959a15ac1ffc5601aca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:46:28.877604 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-96df2566-fb86-45a5-93c7-28b1b1ed5fb2 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] 10.222.0.30 "GET /compute/v2.1/servers/6427d66b-d1b3-4cc1-ba3e-f8a8c479189c" status: 200 len: 1318 microversion: 2.1 time: 0.273851 Dec 24 10:46:28.878443 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 132/246] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:46:28 2021] GET /compute/v2.1/servers/6427d66b-d1b3-4cc1-ba3e-f8a8c479189c => generated 1318 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 24 10:46:28.913241 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-ce13f834-b2a5-42b6-9cd0-2bfbf2d6fbe0 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:46:28.913852 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-ce13f834-b2a5-42b6-9cd0-2bfbf2d6fbe0 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] [instance: c2c661f2-d3da-4357-a7a8-3f85fc94cc60] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:46:28.919846 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-ce13f834-b2a5-42b6-9cd0-2bfbf2d6fbe0 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:28.920296 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-ce13f834-b2a5-42b6-9cd0-2bfbf2d6fbe0 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:28.921106 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-ce13f834-b2a5-42b6-9cd0-2bfbf2d6fbe0 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:28.921721 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-ce13f834-b2a5-42b6-9cd0-2bfbf2d6fbe0 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:29.149433 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-ce13f834-b2a5-42b6-9cd0-2bfbf2d6fbe0 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d627b760f74f48ac560e2ce2e74e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '378bb44ad89440e49f7e290a5d31004e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:46:29.157218 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-ce13f834-b2a5-42b6-9cd0-2bfbf2d6fbe0 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] 10.222.0.30 "GET /compute/v2.1/servers/c2c661f2-d3da-4357-a7a8-3f85fc94cc60" status: 200 len: 1522 microversion: 2.1 time: 0.248105 Dec 24 10:46:29.157804 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 133/247] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:46:28 2021] GET /compute/v2.1/servers/c2c661f2-d3da-4357-a7a8-3f85fc94cc60 => generated 1522 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:46:29.480372 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-8d727bef-1020-4431-b451-a7b34da56d5d tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1439810174", "imageRef": "fae8172d-77c4-4f40-905a-7285c185448c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "12a04c86-5d95-4704-a030-534aa0c4e8bc"}], "security_groups": [{"name": "tempest-securitygroup--411253680"}], "key_name": "tempest-keypair-1861528941", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:46:29.609616 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.network.neutron [None req-8d727bef-1020-4431-b451-a7b34da56d5d tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] validate_networks() for [('12a04c86-5d95-4704-a030-534aa0c4e8bc', None, None, None, None, None)] {{(pid=123431) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 24 10:46:29.964058 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-7ee7b564-5e46-42b4-91aa-16c7ed5fb9bf tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] 10.222.0.30 "POST /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0/action" status: 200 len: 28447 microversion: 2.20 time: 2.988909 Dec 24 10:46:29.969392 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 115/248] 10.222.0.30 () {62 vars in 1318 bytes} [Fri Dec 24 10:46:26 2021] POST /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0/action => generated 28447 bytes in 2992 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 24 10:46:29.993053 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-5c454269-ee2b-4e37-bf51-d957f3dd16fd tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:46:29.994069 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-5c454269-ee2b-4e37-bf51-d957f3dd16fd tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] [instance: 6427d66b-d1b3-4cc1-ba3e-f8a8c479189c] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:46:30.006726 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-5c454269-ee2b-4e37-bf51-d957f3dd16fd tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:30.007663 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-5c454269-ee2b-4e37-bf51-d957f3dd16fd tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:30.008461 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-5c454269-ee2b-4e37-bf51-d957f3dd16fd tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:30.009087 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-5c454269-ee2b-4e37-bf51-d957f3dd16fd tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:30.039987 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.virt.hardware [None req-8d727bef-1020-4431-b451-a7b34da56d5d tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Flavor limits 0:0:0 {{(pid=123431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 24 10:46:30.040495 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.virt.hardware [None req-8d727bef-1020-4431-b451-a7b34da56d5d tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Image limits 0:0:0 {{(pid=123431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 24 10:46:30.041280 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.virt.hardware [None req-8d727bef-1020-4431-b451-a7b34da56d5d tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Flavor pref 0:0:0 {{(pid=123431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 24 10:46:30.041776 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.virt.hardware [None req-8d727bef-1020-4431-b451-a7b34da56d5d tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Image pref 0:0:0 {{(pid=123431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 24 10:46:30.045358 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.virt.hardware [None req-8d727bef-1020-4431-b451-a7b34da56d5d tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 24 10:46:30.058954 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-8d727bef-1020-4431-b451-a7b34da56d5d tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:30.059440 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-8d727bef-1020-4431-b451-a7b34da56d5d tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:30.060262 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-8d727bef-1020-4431-b451-a7b34da56d5d tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:30.060700 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-8d727bef-1020-4431-b451-a7b34da56d5d tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:30.077975 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.quota [None req-8d727bef-1020-4431-b451-a7b34da56d5d tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Getting quotas for project 3f0115a5cc8b4b1e8bffb84e0f3e0b08. Resources: {'instances', 'cores', 'ram'} {{(pid=123431) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 24 10:46:30.082089 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.quota [None req-8d727bef-1020-4431-b451-a7b34da56d5d tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Getting quotas for user 37516225f9244c969ed168f6a024482a and project 3f0115a5cc8b4b1e8bffb84e0f3e0b08. Resources: {'instances', 'cores', 'ram'} {{(pid=123431) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 24 10:46:30.094662 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-8d727bef-1020-4431-b451-a7b34da56d5d tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Going to run 1 instances... {{(pid=123431) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 24 10:46:30.097113 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-8d727bef-1020-4431-b451-a7b34da56d5d tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] [instance: 9330dbb8-edad-4d54-afeb-8badc464250d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fae8172d-77c4-4f40-905a-7285c185448c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123431) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 24 10:46:30.159599 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-5c454269-ee2b-4e37-bf51-d957f3dd16fd tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ad5096717dc425c849dfe95ea55a6af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62d11172cdf4959a15ac1ffc5601aca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:46:30.167911 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-5c454269-ee2b-4e37-bf51-d957f3dd16fd tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] 10.222.0.30 "GET /compute/v2.1/servers/6427d66b-d1b3-4cc1-ba3e-f8a8c479189c" status: 200 len: 1318 microversion: 2.1 time: 0.188800 Dec 24 10:46:30.168478 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 116/249] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:46:29 2021] GET /compute/v2.1/servers/6427d66b-d1b3-4cc1-ba3e-f8a8c479189c => generated 1318 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:46:30.174040 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-6c4596cd-d932-4698-9184-aaa8cf57a169 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:46:30.174708 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-6c4596cd-d932-4698-9184-aaa8cf57a169 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] [instance: c2c661f2-d3da-4357-a7a8-3f85fc94cc60] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:46:30.181036 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-6c4596cd-d932-4698-9184-aaa8cf57a169 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:30.181547 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-6c4596cd-d932-4698-9184-aaa8cf57a169 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:30.182487 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-6c4596cd-d932-4698-9184-aaa8cf57a169 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:30.182947 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-6c4596cd-d932-4698-9184-aaa8cf57a169 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:30.277612 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-8d727bef-1020-4431-b451-a7b34da56d5d tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.802084 Dec 24 10:46:30.278619 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 134/250] 10.222.0.30 () {60 vars in 1146 bytes} [Fri Dec 24 10:46:29 2021] POST /compute/v2.1/servers => generated 401 bytes in 804 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Dec 24 10:46:30.288781 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-0ce92290-1ff2-4a3c-b6f1-7bd2bbf58da2 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:46:30.289408 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-0ce92290-1ff2-4a3c-b6f1-7bd2bbf58da2 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] [instance: 9330dbb8-edad-4d54-afeb-8badc464250d] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:46:30.371044 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-0ce92290-1ff2-4a3c-b6f1-7bd2bbf58da2 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37516225f9244c969ed168f6a024482a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0115a5cc8b4b1e8bffb84e0f3e0b08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:46:30.385120 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-0ce92290-1ff2-4a3c-b6f1-7bd2bbf58da2 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] 10.222.0.30 "GET /compute/v2.1/servers/9330dbb8-edad-4d54-afeb-8badc464250d" status: 200 len: 1238 microversion: 2.1 time: 0.099998 Dec 24 10:46:30.386328 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 135/251] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:46:30 2021] GET /compute/v2.1/servers/9330dbb8-edad-4d54-afeb-8badc464250d => generated 1238 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:46:30.389439 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-6c4596cd-d932-4698-9184-aaa8cf57a169 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d627b760f74f48ac560e2ce2e74e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '378bb44ad89440e49f7e290a5d31004e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:46:30.402341 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-6c4596cd-d932-4698-9184-aaa8cf57a169 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] 10.222.0.30 "GET /compute/v2.1/servers/c2c661f2-d3da-4357-a7a8-3f85fc94cc60" status: 200 len: 1522 microversion: 2.1 time: 0.231626 Dec 24 10:46:30.403386 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 117/252] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:46:30 2021] GET /compute/v2.1/servers/c2c661f2-d3da-4357-a7a8-3f85fc94cc60 => generated 1522 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:46:30.977750 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-52f6b5a0-2165-472a-8e41-f2423139223a tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:46:30.978927 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-52f6b5a0-2165-472a-8e41-f2423139223a tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] [instance: a99a6a98-4010-4f8e-a83f-fcc490f6ece0] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:46:30.985190 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-52f6b5a0-2165-472a-8e41-f2423139223a tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:30.985636 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-52f6b5a0-2165-472a-8e41-f2423139223a tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:30.986414 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-52f6b5a0-2165-472a-8e41-f2423139223a tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:30.986949 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-52f6b5a0-2165-472a-8e41-f2423139223a tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:31.060285 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-52f6b5a0-2165-472a-8e41-f2423139223a tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] 10.222.0.30 "POST /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0/action" status: 200 len: 28447 microversion: 2.20 time: 0.087130 Dec 24 10:46:31.060977 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 136/253] 10.222.0.30 () {62 vars in 1318 bytes} [Fri Dec 24 10:46:30 2021] POST /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0/action => generated 28447 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 24 10:46:31.184893 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-f4a4a2ac-fc43-4adf-bd66-df648cd44474 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:46:31.184893 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-f4a4a2ac-fc43-4adf-bd66-df648cd44474 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] [instance: 6427d66b-d1b3-4cc1-ba3e-f8a8c479189c] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:46:31.191414 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-f4a4a2ac-fc43-4adf-bd66-df648cd44474 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:31.192356 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-f4a4a2ac-fc43-4adf-bd66-df648cd44474 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:31.193151 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-f4a4a2ac-fc43-4adf-bd66-df648cd44474 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:31.193585 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-f4a4a2ac-fc43-4adf-bd66-df648cd44474 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:31.333388 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-f4a4a2ac-fc43-4adf-bd66-df648cd44474 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ad5096717dc425c849dfe95ea55a6af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62d11172cdf4959a15ac1ffc5601aca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:46:31.341745 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-f4a4a2ac-fc43-4adf-bd66-df648cd44474 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] 10.222.0.30 "GET /compute/v2.1/servers/6427d66b-d1b3-4cc1-ba3e-f8a8c479189c" status: 200 len: 1318 microversion: 2.1 time: 0.160928 Dec 24 10:46:31.342307 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 118/254] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:46:31 2021] GET /compute/v2.1/servers/6427d66b-d1b3-4cc1-ba3e-f8a8c479189c => generated 1318 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:46:31.403143 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-922e308c-a7a9-4e59-bfe5-d3ddf2b86d5c tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:46:31.403842 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-922e308c-a7a9-4e59-bfe5-d3ddf2b86d5c tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] [instance: 9330dbb8-edad-4d54-afeb-8badc464250d] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:46:31.419185 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-578996ec-53c4-4b30-b41b-897ec6e71106 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:46:31.419787 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-578996ec-53c4-4b30-b41b-897ec6e71106 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] [instance: c2c661f2-d3da-4357-a7a8-3f85fc94cc60] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:46:31.427361 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-578996ec-53c4-4b30-b41b-897ec6e71106 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:31.427945 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-578996ec-53c4-4b30-b41b-897ec6e71106 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:31.428737 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-578996ec-53c4-4b30-b41b-897ec6e71106 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:31.429264 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-578996ec-53c4-4b30-b41b-897ec6e71106 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:31.456438 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-922e308c-a7a9-4e59-bfe5-d3ddf2b86d5c tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37516225f9244c969ed168f6a024482a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0115a5cc8b4b1e8bffb84e0f3e0b08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:46:31.464282 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-922e308c-a7a9-4e59-bfe5-d3ddf2b86d5c tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] 10.222.0.30 "GET /compute/v2.1/servers/9330dbb8-edad-4d54-afeb-8badc464250d" status: 200 len: 1238 microversion: 2.1 time: 0.065401 Dec 24 10:46:31.464894 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 137/255] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:46:31 2021] GET /compute/v2.1/servers/9330dbb8-edad-4d54-afeb-8badc464250d => generated 1238 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:46:31.583749 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-578996ec-53c4-4b30-b41b-897ec6e71106 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d627b760f74f48ac560e2ce2e74e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '378bb44ad89440e49f7e290a5d31004e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:46:31.591711 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-578996ec-53c4-4b30-b41b-897ec6e71106 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] 10.222.0.30 "GET /compute/v2.1/servers/c2c661f2-d3da-4357-a7a8-3f85fc94cc60" status: 200 len: 1522 microversion: 2.1 time: 0.176157 Dec 24 10:46:31.592268 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 119/256] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:46:31 2021] GET /compute/v2.1/servers/c2c661f2-d3da-4357-a7a8-3f85fc94cc60 => generated 1522 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 24 10:46:32.071870 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-a1611553-2716-4d5e-8147-9e0e5a58a32e tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:46:32.072749 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-a1611553-2716-4d5e-8147-9e0e5a58a32e tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] [instance: a99a6a98-4010-4f8e-a83f-fcc490f6ece0] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:46:32.079180 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-a1611553-2716-4d5e-8147-9e0e5a58a32e tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:32.079614 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-a1611553-2716-4d5e-8147-9e0e5a58a32e tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:32.080376 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-a1611553-2716-4d5e-8147-9e0e5a58a32e tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:32.080797 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-a1611553-2716-4d5e-8147-9e0e5a58a32e tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:32.358171 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-5d46358a-3f97-482a-9cf0-2d46bb8e7538 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:46:32.358781 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-5d46358a-3f97-482a-9cf0-2d46bb8e7538 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] [instance: 6427d66b-d1b3-4cc1-ba3e-f8a8c479189c] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:46:32.365893 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-5d46358a-3f97-482a-9cf0-2d46bb8e7538 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:32.366341 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-5d46358a-3f97-482a-9cf0-2d46bb8e7538 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:32.367172 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-5d46358a-3f97-482a-9cf0-2d46bb8e7538 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:32.367644 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-5d46358a-3f97-482a-9cf0-2d46bb8e7538 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:32.502557 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-5d46358a-3f97-482a-9cf0-2d46bb8e7538 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ad5096717dc425c849dfe95ea55a6af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62d11172cdf4959a15ac1ffc5601aca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:46:32.521932 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-5d46358a-3f97-482a-9cf0-2d46bb8e7538 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] 10.222.0.30 "GET /compute/v2.1/servers/6427d66b-d1b3-4cc1-ba3e-f8a8c479189c" status: 200 len: 1508 microversion: 2.1 time: 0.167557 Dec 24 10:46:32.522504 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 120/257] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:46:32 2021] GET /compute/v2.1/servers/6427d66b-d1b3-4cc1-ba3e-f8a8c479189c => generated 1508 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 24 10:46:32.538334 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-3616f2c6-2331-4433-9342-eae68d6a9760 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:46:32.539262 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-3616f2c6-2331-4433-9342-eae68d6a9760 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] [instance: 9330dbb8-edad-4d54-afeb-8badc464250d] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:46:32.553679 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-3616f2c6-2331-4433-9342-eae68d6a9760 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:32.555274 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-3616f2c6-2331-4433-9342-eae68d6a9760 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:32.555274 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-3616f2c6-2331-4433-9342-eae68d6a9760 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:32.555658 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-3616f2c6-2331-4433-9342-eae68d6a9760 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:32.619458 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-3616f2c6-2331-4433-9342-eae68d6a9760 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37516225f9244c969ed168f6a024482a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0115a5cc8b4b1e8bffb84e0f3e0b08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:46:32.621301 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-3616f2c6-2331-4433-9342-eae68d6a9760 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] 10.222.0.30 "GET /compute/v2.1/servers/9330dbb8-edad-4d54-afeb-8badc464250d" status: 200 len: 1242 microversion: 2.1 time: 0.097845 Dec 24 10:46:32.621861 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 121/258] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:46:32 2021] GET /compute/v2.1/servers/9330dbb8-edad-4d54-afeb-8badc464250d => generated 1242 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:46:32.626369 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-df6a2a50-0564-4057-8c73-18e8c46ef5ae tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c9534bc6-5ae7-42a7-83a7-86c2830d0d7c"}} {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:46:32.627470 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-df6a2a50-0564-4057-8c73-18e8c46ef5ae tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] [instance: 6427d66b-d1b3-4cc1-ba3e-f8a8c479189c] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:46:32.633921 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-df6a2a50-0564-4057-8c73-18e8c46ef5ae tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:32.634360 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-df6a2a50-0564-4057-8c73-18e8c46ef5ae tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:32.635133 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-df6a2a50-0564-4057-8c73-18e8c46ef5ae tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:32.635557 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-df6a2a50-0564-4057-8c73-18e8c46ef5ae tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:32.717452 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.wsgi [None req-df6a2a50-0564-4057-8c73-18e8c46ef5ae tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] HTTP exception thrown: Invalid volume: volume c9534bc6-5ae7-42a7-83a7-86c2830d0d7c is already attached to instances: b18ab8db-0c1f-4343-ae07-953fc820b211 Dec 24 10:46:32.718202 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-df6a2a50-0564-4057-8c73-18e8c46ef5ae tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Returning 400 to user: Invalid volume: volume c9534bc6-5ae7-42a7-83a7-86c2830d0d7c is already attached to instances: b18ab8db-0c1f-4343-ae07-953fc820b211 {{(pid=123432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 24 10:46:32.719109 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-df6a2a50-0564-4057-8c73-18e8c46ef5ae tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] 10.222.0.30 "POST /compute/v2.1/servers/6427d66b-d1b3-4cc1-ba3e-f8a8c479189c/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.096354 Dec 24 10:46:32.719734 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 122/259] 10.222.0.30 () {60 vars in 1322 bytes} [Fri Dec 24 10:46:32 2021] POST /compute/v2.1/servers/6427d66b-d1b3-4cc1-ba3e-f8a8c479189c/os-volume_attachments => generated 174 bytes in 97 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Dec 24 10:46:32.724793 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-1d9613f9-0258-4f89-a2ad-8f0494598d11 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:46:32.725421 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-1d9613f9-0258-4f89-a2ad-8f0494598d11 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] [instance: c2c661f2-d3da-4357-a7a8-3f85fc94cc60] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:46:32.735645 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-1d9613f9-0258-4f89-a2ad-8f0494598d11 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:32.739005 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-1d9613f9-0258-4f89-a2ad-8f0494598d11 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:32.739005 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-1d9613f9-0258-4f89-a2ad-8f0494598d11 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:32.739005 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-1d9613f9-0258-4f89-a2ad-8f0494598d11 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:32.884612 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-1d9613f9-0258-4f89-a2ad-8f0494598d11 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d627b760f74f48ac560e2ce2e74e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '378bb44ad89440e49f7e290a5d31004e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:46:32.892295 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-1d9613f9-0258-4f89-a2ad-8f0494598d11 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] 10.222.0.30 "GET /compute/v2.1/servers/c2c661f2-d3da-4357-a7a8-3f85fc94cc60" status: 200 len: 1522 microversion: 2.1 time: 0.171556 Dec 24 10:46:32.894194 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 123/260] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:46:32 2021] GET /compute/v2.1/servers/c2c661f2-d3da-4357-a7a8-3f85fc94cc60 => generated 1522 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:46:32.898053 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-c32e33c9-4d41-4f06-bc92-fcfb773452bb tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:46:32.898792 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-c32e33c9-4d41-4f06-bc92-fcfb773452bb tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] [instance: b18ab8db-0c1f-4343-ae07-953fc820b211] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:46:32.904583 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-c32e33c9-4d41-4f06-bc92-fcfb773452bb tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:32.905080 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-c32e33c9-4d41-4f06-bc92-fcfb773452bb tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:32.905859 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-c32e33c9-4d41-4f06-bc92-fcfb773452bb tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:32.906287 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-c32e33c9-4d41-4f06-bc92-fcfb773452bb tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:33.166678 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.objects.instance [None req-c32e33c9-4d41-4f06-bc92-fcfb773452bb tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lazy-loading 'services' on Instance uuid b18ab8db-0c1f-4343-ae07-953fc820b211 {{(pid=123432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 24 10:46:33.480454 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-c32e33c9-4d41-4f06-bc92-fcfb773452bb tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] 10.222.0.30 "DELETE /compute/v2.1/servers/b18ab8db-0c1f-4343-ae07-953fc820b211/os-volume_attachments/c9534bc6-5ae7-42a7-83a7-86c2830d0d7c" status: 202 len: 0 microversion: 2.1 time: 0.586308 Dec 24 10:46:33.481130 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 124/261] 10.222.0.30 () {58 vars in 1415 bytes} [Fri Dec 24 10:46:32 2021] DELETE /compute/v2.1/servers/b18ab8db-0c1f-4343-ae07-953fc820b211/os-volume_attachments/c9534bc6-5ae7-42a7-83a7-86c2830d0d7c => generated 0 bytes in 588 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 24 10:46:33.490041 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-08e7715a-88f5-4e86-879e-923909300e67 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:46:33.491065 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-08e7715a-88f5-4e86-879e-923909300e67 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] [instance: b18ab8db-0c1f-4343-ae07-953fc820b211] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:46:33.497162 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-08e7715a-88f5-4e86-879e-923909300e67 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:33.497601 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-08e7715a-88f5-4e86-879e-923909300e67 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:33.498366 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-08e7715a-88f5-4e86-879e-923909300e67 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:33.498790 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-08e7715a-88f5-4e86-879e-923909300e67 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:33.526860 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-08e7715a-88f5-4e86-879e-923909300e67 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] 10.222.0.30 "GET /compute/v2.1/servers/b18ab8db-0c1f-4343-ae07-953fc820b211/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041194 Dec 24 10:46:33.527391 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 125/262] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Dec 24 10:46:33 2021] GET /compute/v2.1/servers/b18ab8db-0c1f-4343-ae07-953fc820b211/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 24 10:46:33.637920 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-bef7f681-3a5e-40ac-9f56-b3d1b38ae32b tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:46:33.638525 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-bef7f681-3a5e-40ac-9f56-b3d1b38ae32b tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] [instance: 9330dbb8-edad-4d54-afeb-8badc464250d] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:46:33.644446 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-bef7f681-3a5e-40ac-9f56-b3d1b38ae32b tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:33.645004 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-bef7f681-3a5e-40ac-9f56-b3d1b38ae32b tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:33.645869 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-bef7f681-3a5e-40ac-9f56-b3d1b38ae32b tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:33.646308 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-bef7f681-3a5e-40ac-9f56-b3d1b38ae32b tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:33.707902 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-bef7f681-3a5e-40ac-9f56-b3d1b38ae32b tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37516225f9244c969ed168f6a024482a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0115a5cc8b4b1e8bffb84e0f3e0b08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:46:33.715168 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-bef7f681-3a5e-40ac-9f56-b3d1b38ae32b tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] 10.222.0.30 "GET /compute/v2.1/servers/9330dbb8-edad-4d54-afeb-8badc464250d" status: 200 len: 1234 microversion: 2.1 time: 0.080784 Dec 24 10:46:33.715718 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 126/263] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:46:33 2021] GET /compute/v2.1/servers/9330dbb8-edad-4d54-afeb-8badc464250d => generated 1234 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 24 10:46:33.909015 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-f77612e1-57f7-4a04-a603-e953e2994ae4 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:46:33.909631 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-f77612e1-57f7-4a04-a603-e953e2994ae4 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] [instance: c2c661f2-d3da-4357-a7a8-3f85fc94cc60] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:46:33.916066 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-f77612e1-57f7-4a04-a603-e953e2994ae4 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:33.916511 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-f77612e1-57f7-4a04-a603-e953e2994ae4 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:33.917319 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-f77612e1-57f7-4a04-a603-e953e2994ae4 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:33.917762 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-f77612e1-57f7-4a04-a603-e953e2994ae4 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:34.044169 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-f77612e1-57f7-4a04-a603-e953e2994ae4 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d627b760f74f48ac560e2ce2e74e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '378bb44ad89440e49f7e290a5d31004e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:46:34.051394 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-f77612e1-57f7-4a04-a603-e953e2994ae4 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] 10.222.0.30 "GET /compute/v2.1/servers/c2c661f2-d3da-4357-a7a8-3f85fc94cc60" status: 200 len: 1522 microversion: 2.1 time: 0.145982 Dec 24 10:46:34.051955 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 127/264] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:46:33 2021] GET /compute/v2.1/servers/c2c661f2-d3da-4357-a7a8-3f85fc94cc60 => generated 1522 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 24 10:46:34.538176 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-274828c7-8b0d-4f37-99ce-2728335c490a tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:46:34.539135 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-274828c7-8b0d-4f37-99ce-2728335c490a tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] [instance: b18ab8db-0c1f-4343-ae07-953fc820b211] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:46:34.545408 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-274828c7-8b0d-4f37-99ce-2728335c490a tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:34.545852 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-274828c7-8b0d-4f37-99ce-2728335c490a tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:34.546622 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-274828c7-8b0d-4f37-99ce-2728335c490a tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:34.547051 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-274828c7-8b0d-4f37-99ce-2728335c490a tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:34.575310 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-274828c7-8b0d-4f37-99ce-2728335c490a tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] 10.222.0.30 "GET /compute/v2.1/servers/b18ab8db-0c1f-4343-ae07-953fc820b211/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040917 Dec 24 10:46:34.575840 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 128/265] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Dec 24 10:46:34 2021] GET /compute/v2.1/servers/b18ab8db-0c1f-4343-ae07-953fc820b211/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 24 10:46:34.732124 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-dafe29d8-cfb6-4da2-979d-763fb309027e tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:46:34.732728 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-dafe29d8-cfb6-4da2-979d-763fb309027e tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] [instance: 9330dbb8-edad-4d54-afeb-8badc464250d] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:46:34.739056 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-dafe29d8-cfb6-4da2-979d-763fb309027e tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:34.739506 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-dafe29d8-cfb6-4da2-979d-763fb309027e tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:34.740307 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-dafe29d8-cfb6-4da2-979d-763fb309027e tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:34.740751 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-dafe29d8-cfb6-4da2-979d-763fb309027e tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:34.796553 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-dafe29d8-cfb6-4da2-979d-763fb309027e tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37516225f9244c969ed168f6a024482a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0115a5cc8b4b1e8bffb84e0f3e0b08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:46:34.804238 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-dafe29d8-cfb6-4da2-979d-763fb309027e tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] 10.222.0.30 "GET /compute/v2.1/servers/9330dbb8-edad-4d54-afeb-8badc464250d" status: 200 len: 1234 microversion: 2.1 time: 0.075725 Dec 24 10:46:34.804789 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 129/266] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:46:34 2021] GET /compute/v2.1/servers/9330dbb8-edad-4d54-afeb-8badc464250d => generated 1234 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 24 10:46:34.898853 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-a1611553-2716-4d5e-8147-9e0e5a58a32e tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] 10.222.0.30 "POST /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0/action" status: 200 len: 28614 microversion: 2.20 time: 2.830240 Dec 24 10:46:34.902817 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 138/267] 10.222.0.30 () {62 vars in 1318 bytes} [Fri Dec 24 10:46:32 2021] POST /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0/action => generated 28614 bytes in 2832 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 24 10:46:35.068193 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-810e745f-b29e-48b6-a231-670701c38df4 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:46:35.068757 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-810e745f-b29e-48b6-a231-670701c38df4 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] [instance: c2c661f2-d3da-4357-a7a8-3f85fc94cc60] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:46:35.074566 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-810e745f-b29e-48b6-a231-670701c38df4 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:35.075019 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-810e745f-b29e-48b6-a231-670701c38df4 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:35.075797 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-810e745f-b29e-48b6-a231-670701c38df4 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:35.076232 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-810e745f-b29e-48b6-a231-670701c38df4 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:35.213323 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-810e745f-b29e-48b6-a231-670701c38df4 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d627b760f74f48ac560e2ce2e74e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '378bb44ad89440e49f7e290a5d31004e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:46:35.220764 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-810e745f-b29e-48b6-a231-670701c38df4 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] 10.222.0.30 "GET /compute/v2.1/servers/c2c661f2-d3da-4357-a7a8-3f85fc94cc60" status: 200 len: 1522 microversion: 2.1 time: 0.156267 Dec 24 10:46:35.221347 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 130/268] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:46:35 2021] GET /compute/v2.1/servers/c2c661f2-d3da-4357-a7a8-3f85fc94cc60 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:46:35.587615 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-4dba892c-5794-443f-a9d9-d4821fd88291 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:46:35.588621 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-4dba892c-5794-443f-a9d9-d4821fd88291 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] [instance: b18ab8db-0c1f-4343-ae07-953fc820b211] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:46:35.596435 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-4dba892c-5794-443f-a9d9-d4821fd88291 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:35.596910 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-4dba892c-5794-443f-a9d9-d4821fd88291 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:35.598319 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-4dba892c-5794-443f-a9d9-d4821fd88291 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:35.598766 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-4dba892c-5794-443f-a9d9-d4821fd88291 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:35.630087 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-4dba892c-5794-443f-a9d9-d4821fd88291 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] 10.222.0.30 "GET /compute/v2.1/servers/b18ab8db-0c1f-4343-ae07-953fc820b211/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046576 Dec 24 10:46:35.630856 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 139/269] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Dec 24 10:46:35 2021] GET /compute/v2.1/servers/b18ab8db-0c1f-4343-ae07-953fc820b211/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 10:46:35.821903 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-8c40f609-3eba-4b23-9e8b-5a82f6ca97d9 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:46:35.823741 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-8c40f609-3eba-4b23-9e8b-5a82f6ca97d9 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] [instance: 9330dbb8-edad-4d54-afeb-8badc464250d] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:46:35.832850 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-8c40f609-3eba-4b23-9e8b-5a82f6ca97d9 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:35.833450 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-8c40f609-3eba-4b23-9e8b-5a82f6ca97d9 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:35.834595 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-8c40f609-3eba-4b23-9e8b-5a82f6ca97d9 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:35.835321 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-8c40f609-3eba-4b23-9e8b-5a82f6ca97d9 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:35.894019 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-8c40f609-3eba-4b23-9e8b-5a82f6ca97d9 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37516225f9244c969ed168f6a024482a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0115a5cc8b4b1e8bffb84e0f3e0b08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:46:35.901419 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-8c40f609-3eba-4b23-9e8b-5a82f6ca97d9 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] 10.222.0.30 "GET /compute/v2.1/servers/9330dbb8-edad-4d54-afeb-8badc464250d" status: 200 len: 1290 microversion: 2.1 time: 0.084420 Dec 24 10:46:35.902172 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 131/270] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:46:35 2021] GET /compute/v2.1/servers/9330dbb8-edad-4d54-afeb-8badc464250d => generated 1290 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:46:35.910909 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-4307f497-2645-4bf5-9247-2b93eb5e5fc1 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:46:35.911862 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-4307f497-2645-4bf5-9247-2b93eb5e5fc1 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] [instance: a99a6a98-4010-4f8e-a83f-fcc490f6ece0] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:46:35.918137 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-4307f497-2645-4bf5-9247-2b93eb5e5fc1 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:35.918579 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-4307f497-2645-4bf5-9247-2b93eb5e5fc1 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:35.919357 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-4307f497-2645-4bf5-9247-2b93eb5e5fc1 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:35.919786 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-4307f497-2645-4bf5-9247-2b93eb5e5fc1 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:36.008458 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-4307f497-2645-4bf5-9247-2b93eb5e5fc1 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] 10.222.0.30 "POST /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0/action" status: 200 len: 28614 microversion: 2.20 time: 0.101513 Dec 24 10:46:36.009144 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 140/271] 10.222.0.30 () {62 vars in 1318 bytes} [Fri Dec 24 10:46:35 2021] POST /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0/action => generated 28614 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 24 10:46:36.237469 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-6f8037a2-9f16-4aa4-bed1-41701c9e3886 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:46:36.238076 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-6f8037a2-9f16-4aa4-bed1-41701c9e3886 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] [instance: c2c661f2-d3da-4357-a7a8-3f85fc94cc60] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:46:36.244257 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-6f8037a2-9f16-4aa4-bed1-41701c9e3886 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:36.244700 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-6f8037a2-9f16-4aa4-bed1-41701c9e3886 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:36.245515 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-6f8037a2-9f16-4aa4-bed1-41701c9e3886 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:36.245970 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-6f8037a2-9f16-4aa4-bed1-41701c9e3886 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:36.386804 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-6f8037a2-9f16-4aa4-bed1-41701c9e3886 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d627b760f74f48ac560e2ce2e74e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '378bb44ad89440e49f7e290a5d31004e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:46:36.395095 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-6f8037a2-9f16-4aa4-bed1-41701c9e3886 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] 10.222.0.30 "GET /compute/v2.1/servers/c2c661f2-d3da-4357-a7a8-3f85fc94cc60" status: 200 len: 1522 microversion: 2.1 time: 0.160666 Dec 24 10:46:36.395830 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 132/272] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:46:36 2021] GET /compute/v2.1/servers/c2c661f2-d3da-4357-a7a8-3f85fc94cc60 => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:46:36.644798 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-94f045e3-baa9-4c73-a881-af1911b1893b tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:46:36.646280 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-94f045e3-baa9-4c73-a881-af1911b1893b tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] [instance: b18ab8db-0c1f-4343-ae07-953fc820b211] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:46:36.665165 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-94f045e3-baa9-4c73-a881-af1911b1893b tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:36.666320 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-94f045e3-baa9-4c73-a881-af1911b1893b tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:36.667342 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-94f045e3-baa9-4c73-a881-af1911b1893b tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:36.667983 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-94f045e3-baa9-4c73-a881-af1911b1893b tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:36.712574 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-94f045e3-baa9-4c73-a881-af1911b1893b tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] 10.222.0.30 "GET /compute/v2.1/servers/b18ab8db-0c1f-4343-ae07-953fc820b211/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.072931 Dec 24 10:46:36.713540 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 141/273] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Dec 24 10:46:36 2021] GET /compute/v2.1/servers/b18ab8db-0c1f-4343-ae07-953fc820b211/os-volume_attachments => generated 25 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 24 10:46:36.919505 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-8674496e-8db0-4345-b2a1-8b542c8b67d4 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:46:36.920378 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-8674496e-8db0-4345-b2a1-8b542c8b67d4 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] [instance: 9330dbb8-edad-4d54-afeb-8badc464250d] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:46:36.927869 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-8674496e-8db0-4345-b2a1-8b542c8b67d4 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:36.929000 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-8674496e-8db0-4345-b2a1-8b542c8b67d4 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:36.932849 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-8674496e-8db0-4345-b2a1-8b542c8b67d4 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:36.932849 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-8674496e-8db0-4345-b2a1-8b542c8b67d4 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:37.013288 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-5a8f4c91-9ea2-40af-bfc5-019f3c61efad tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1573293776", "imageRef": "fae8172d-77c4-4f40-905a-7285c185448c", "flavorRef": "452", "networks": [{"uuid": "8016a0c6-9874-4e24-99d5-a347d449be0f"}]}} {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:46:37.073159 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.network.neutron [None req-5a8f4c91-9ea2-40af-bfc5-019f3c61efad tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] validate_networks() for [('8016a0c6-9874-4e24-99d5-a347d449be0f', None, None, None, None, None)] {{(pid=123431) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 24 10:46:37.109075 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-8674496e-8db0-4345-b2a1-8b542c8b67d4 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37516225f9244c969ed168f6a024482a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0115a5cc8b4b1e8bffb84e0f3e0b08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:46:37.116989 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-8674496e-8db0-4345-b2a1-8b542c8b67d4 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] 10.222.0.30 "GET /compute/v2.1/servers/9330dbb8-edad-4d54-afeb-8badc464250d" status: 200 len: 1363 microversion: 2.1 time: 0.201836 Dec 24 10:46:37.118126 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 133/274] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:46:36 2021] GET /compute/v2.1/servers/9330dbb8-edad-4d54-afeb-8badc464250d => generated 1363 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:46:37.123674 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-a1b6f9ab-36eb-4aca-b7ad-c55135efb3e2 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:46:37.124592 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-a1b6f9ab-36eb-4aca-b7ad-c55135efb3e2 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] [instance: a99a6a98-4010-4f8e-a83f-fcc490f6ece0] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:46:37.130800 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-a1b6f9ab-36eb-4aca-b7ad-c55135efb3e2 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:37.131249 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-a1b6f9ab-36eb-4aca-b7ad-c55135efb3e2 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:37.136109 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-a1b6f9ab-36eb-4aca-b7ad-c55135efb3e2 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:37.136109 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-a1b6f9ab-36eb-4aca-b7ad-c55135efb3e2 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:37.215564 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-a1b6f9ab-36eb-4aca-b7ad-c55135efb3e2 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] 10.222.0.30 "POST /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0/action" status: 200 len: 28614 microversion: 2.20 time: 0.095788 Dec 24 10:46:37.217177 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 134/275] 10.222.0.30 () {62 vars in 1318 bytes} [Fri Dec 24 10:46:37 2021] POST /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0/action => generated 28614 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 24 10:46:37.414797 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-d1332285-68d4-4f02-8df6-c459c9a6a823 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:46:37.415415 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-d1332285-68d4-4f02-8df6-c459c9a6a823 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] [instance: c2c661f2-d3da-4357-a7a8-3f85fc94cc60] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:46:37.423776 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-d1332285-68d4-4f02-8df6-c459c9a6a823 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:37.424450 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-d1332285-68d4-4f02-8df6-c459c9a6a823 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:37.425462 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-d1332285-68d4-4f02-8df6-c459c9a6a823 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:37.426001 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-d1332285-68d4-4f02-8df6-c459c9a6a823 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:37.502744 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.virt.hardware [None req-5a8f4c91-9ea2-40af-bfc5-019f3c61efad tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Flavor limits 0:0:0 {{(pid=123431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 24 10:46:37.503170 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.virt.hardware [None req-5a8f4c91-9ea2-40af-bfc5-019f3c61efad tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Image limits 0:0:0 {{(pid=123431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 24 10:46:37.503768 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.virt.hardware [None req-5a8f4c91-9ea2-40af-bfc5-019f3c61efad tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Flavor pref 0:0:0 {{(pid=123431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 24 10:46:37.504704 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.virt.hardware [None req-5a8f4c91-9ea2-40af-bfc5-019f3c61efad tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Image pref 0:0:0 {{(pid=123431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 24 10:46:37.505144 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.virt.hardware [None req-5a8f4c91-9ea2-40af-bfc5-019f3c61efad tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 24 10:46:37.515510 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-5a8f4c91-9ea2-40af-bfc5-019f3c61efad tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:37.515946 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-5a8f4c91-9ea2-40af-bfc5-019f3c61efad tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:37.516949 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-5a8f4c91-9ea2-40af-bfc5-019f3c61efad tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:37.517826 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-5a8f4c91-9ea2-40af-bfc5-019f3c61efad tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:37.536904 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.quota [None req-5a8f4c91-9ea2-40af-bfc5-019f3c61efad tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Getting quotas for project e62d11172cdf4959a15ac1ffc5601aca. Resources: {'instances', 'cores', 'ram'} {{(pid=123431) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 24 10:46:37.543279 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.quota [None req-5a8f4c91-9ea2-40af-bfc5-019f3c61efad tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Getting quotas for user 5ad5096717dc425c849dfe95ea55a6af and project e62d11172cdf4959a15ac1ffc5601aca. Resources: {'instances', 'cores', 'ram'} {{(pid=123431) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 24 10:46:37.564878 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-5a8f4c91-9ea2-40af-bfc5-019f3c61efad tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Going to run 1 instances... {{(pid=123431) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 24 10:46:37.568747 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-5a8f4c91-9ea2-40af-bfc5-019f3c61efad tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] [instance: fb8d3af9-4513-4f65-8863-0f910fd46f04] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fae8172d-77c4-4f40-905a-7285c185448c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123431) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 24 10:46:37.643880 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-d1332285-68d4-4f02-8df6-c459c9a6a823 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d627b760f74f48ac560e2ce2e74e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '378bb44ad89440e49f7e290a5d31004e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:46:37.652012 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-d1332285-68d4-4f02-8df6-c459c9a6a823 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] 10.222.0.30 "GET /compute/v2.1/servers/c2c661f2-d3da-4357-a7a8-3f85fc94cc60" status: 200 len: 1522 microversion: 2.1 time: 0.242599 Dec 24 10:46:37.652685 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 135/276] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:46:37 2021] GET /compute/v2.1/servers/c2c661f2-d3da-4357-a7a8-3f85fc94cc60 => generated 1522 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 24 10:46:37.694134 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-5a8f4c91-9ea2-40af-bfc5-019f3c61efad tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.684284 Dec 24 10:46:37.695002 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 142/277] 10.222.0.30 () {60 vars in 1146 bytes} [Fri Dec 24 10:46:37 2021] POST /compute/v2.1/servers => generated 380 bytes in 686 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Dec 24 10:46:37.705035 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-2855b86b-fcaf-4031-859d-9b6bc1910759 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:46:37.705699 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-2855b86b-fcaf-4031-859d-9b6bc1910759 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] [instance: fb8d3af9-4513-4f65-8863-0f910fd46f04] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:46:37.760668 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-2855b86b-fcaf-4031-859d-9b6bc1910759 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ad5096717dc425c849dfe95ea55a6af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62d11172cdf4959a15ac1ffc5601aca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:46:37.772624 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-2855b86b-fcaf-4031-859d-9b6bc1910759 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] 10.222.0.30 "GET /compute/v2.1/servers/fb8d3af9-4513-4f65-8863-0f910fd46f04" status: 200 len: 1218 microversion: 2.1 time: 0.071293 Dec 24 10:46:37.773223 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 136/278] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:46:37 2021] GET /compute/v2.1/servers/fb8d3af9-4513-4f65-8863-0f910fd46f04 => generated 1218 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:46:38.136627 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-36c37d3c-8742-49f2-a297-b6f587e0339a tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:46:38.137453 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-36c37d3c-8742-49f2-a297-b6f587e0339a tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] [instance: 9330dbb8-edad-4d54-afeb-8badc464250d] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:46:38.145326 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-36c37d3c-8742-49f2-a297-b6f587e0339a tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:38.145326 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-36c37d3c-8742-49f2-a297-b6f587e0339a tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:38.146160 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-36c37d3c-8742-49f2-a297-b6f587e0339a tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:38.147412 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-36c37d3c-8742-49f2-a297-b6f587e0339a tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:38.173371 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [req-c125492c-977b-4f1f-a469-95da6265bf74 req-4e827313-be3c-4b85-88f6-3337ffed4768 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9330dbb8-edad-4d54-afeb-8badc464250d", "tag": "0cea520e-6ec2-4fe3-8f62-bfb44b96b73e"}]} {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:46:38.179268 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 10:46:38.179268 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: warnings.warn(msg) Dec 24 10:46:38.186084 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [req-c125492c-977b-4f1f-a469-95da6265bf74 req-4e827313-be3c-4b85-88f6-3337ffed4768 service nova] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:38.186542 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [req-c125492c-977b-4f1f-a469-95da6265bf74 req-4e827313-be3c-4b85-88f6-3337ffed4768 service nova] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:38.212324 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.compute.server_external_events [req-c125492c-977b-4f1f-a469-95da6265bf74 req-4e827313-be3c-4b85-88f6-3337ffed4768 service nova] Creating event network-changed:0cea520e-6ec2-4fe3-8f62-bfb44b96b73e for instance 9330dbb8-edad-4d54-afeb-8badc464250d on hv-cinder-81644 Dec 24 10:46:38.217348 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [req-c125492c-977b-4f1f-a469-95da6265bf74 req-4e827313-be3c-4b85-88f6-3337ffed4768 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047320 Dec 24 10:46:38.229017 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 137/279] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Dec 24 10:46:38 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 10:46:38.244088 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-72b53fec-6298-44e9-a49e-79887d231c52 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:46:38.251124 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-72b53fec-6298-44e9-a49e-79887d231c52 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] [instance: a99a6a98-4010-4f8e-a83f-fcc490f6ece0] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:46:38.267657 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-72b53fec-6298-44e9-a49e-79887d231c52 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:38.268172 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-72b53fec-6298-44e9-a49e-79887d231c52 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:38.271361 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-72b53fec-6298-44e9-a49e-79887d231c52 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:38.271815 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-72b53fec-6298-44e9-a49e-79887d231c52 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:38.370665 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-36c37d3c-8742-49f2-a297-b6f587e0339a tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37516225f9244c969ed168f6a024482a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0115a5cc8b4b1e8bffb84e0f3e0b08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:46:38.382337 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-36c37d3c-8742-49f2-a297-b6f587e0339a tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] 10.222.0.30 "GET /compute/v2.1/servers/9330dbb8-edad-4d54-afeb-8badc464250d" status: 200 len: 1363 microversion: 2.1 time: 0.250614 Dec 24 10:46:38.384106 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 143/280] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:46:38 2021] GET /compute/v2.1/servers/9330dbb8-edad-4d54-afeb-8badc464250d => generated 1363 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:46:38.400004 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-72b53fec-6298-44e9-a49e-79887d231c52 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] 10.222.0.30 "POST /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0/action" status: 200 len: 28614 microversion: 2.20 time: 0.174682 Dec 24 10:46:38.401416 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 138/281] 10.222.0.30 () {62 vars in 1318 bytes} [Fri Dec 24 10:46:38 2021] POST /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0/action => generated 28614 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 24 10:46:38.668792 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-2d39d2a7-99d4-46b6-a650-a58ca0f0a943 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:46:38.669721 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-2d39d2a7-99d4-46b6-a650-a58ca0f0a943 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] [instance: c2c661f2-d3da-4357-a7a8-3f85fc94cc60] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:46:38.677688 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-2d39d2a7-99d4-46b6-a650-a58ca0f0a943 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:38.678635 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-2d39d2a7-99d4-46b6-a650-a58ca0f0a943 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:38.679663 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-2d39d2a7-99d4-46b6-a650-a58ca0f0a943 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:38.680253 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-2d39d2a7-99d4-46b6-a650-a58ca0f0a943 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:38.789947 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-5fcdcab2-8204-4284-96b8-13f91d7205f9 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:46:38.790658 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-5fcdcab2-8204-4284-96b8-13f91d7205f9 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] [instance: fb8d3af9-4513-4f65-8863-0f910fd46f04] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:46:38.798018 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-5fcdcab2-8204-4284-96b8-13f91d7205f9 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:38.798767 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-5fcdcab2-8204-4284-96b8-13f91d7205f9 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:38.799837 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-5fcdcab2-8204-4284-96b8-13f91d7205f9 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:38.800562 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-5fcdcab2-8204-4284-96b8-13f91d7205f9 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:38.932711 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-5fcdcab2-8204-4284-96b8-13f91d7205f9 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ad5096717dc425c849dfe95ea55a6af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62d11172cdf4959a15ac1ffc5601aca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:46:38.943904 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-5fcdcab2-8204-4284-96b8-13f91d7205f9 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] 10.222.0.30 "GET /compute/v2.1/servers/fb8d3af9-4513-4f65-8863-0f910fd46f04" status: 200 len: 1222 microversion: 2.1 time: 0.155036 Dec 24 10:46:38.945073 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 139/282] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:46:38 2021] GET /compute/v2.1/servers/fb8d3af9-4513-4f65-8863-0f910fd46f04 => generated 1222 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:46:38.961973 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-2d39d2a7-99d4-46b6-a650-a58ca0f0a943 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d627b760f74f48ac560e2ce2e74e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '378bb44ad89440e49f7e290a5d31004e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:46:38.969535 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-2d39d2a7-99d4-46b6-a650-a58ca0f0a943 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] 10.222.0.30 "GET /compute/v2.1/servers/c2c661f2-d3da-4357-a7a8-3f85fc94cc60" status: 200 len: 1502 microversion: 2.1 time: 0.304789 Dec 24 10:46:38.972349 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 144/283] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:46:38 2021] GET /compute/v2.1/servers/c2c661f2-d3da-4357-a7a8-3f85fc94cc60 => generated 1502 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:46:38.997628 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-044b4b81-da4f-4a73-a687-d837a1f0a5a0 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:46:38.998495 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-044b4b81-da4f-4a73-a687-d837a1f0a5a0 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] [instance: 54d2f913-8385-4f34-8cb0-8c0f08c7a30f] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:46:39.005738 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-044b4b81-da4f-4a73-a687-d837a1f0a5a0 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:39.006408 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-044b4b81-da4f-4a73-a687-d837a1f0a5a0 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:39.007370 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-044b4b81-da4f-4a73-a687-d837a1f0a5a0 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:39.008017 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-044b4b81-da4f-4a73-a687-d837a1f0a5a0 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:39.407328 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-a5849816-3748-4238-8908-b855b2a2b69e tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:46:39.408684 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-a5849816-3748-4238-8908-b855b2a2b69e tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] [instance: 9330dbb8-edad-4d54-afeb-8badc464250d] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:46:39.418988 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-a5849816-3748-4238-8908-b855b2a2b69e tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:39.420108 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-a5849816-3748-4238-8908-b855b2a2b69e tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:39.423292 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-a5849816-3748-4238-8908-b855b2a2b69e tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:39.432749 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-a5849816-3748-4238-8908-b855b2a2b69e tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:39.471434 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-044b4b81-da4f-4a73-a687-d837a1f0a5a0 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d627b760f74f48ac560e2ce2e74e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '378bb44ad89440e49f7e290a5d31004e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:46:39.480485 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-044b4b81-da4f-4a73-a687-d837a1f0a5a0 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] 10.222.0.30 "GET /compute/v2.1/servers/54d2f913-8385-4f34-8cb0-8c0f08c7a30f" status: 200 len: 1516 microversion: 2.1 time: 0.487204 Dec 24 10:46:39.481405 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 140/284] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:46:38 2021] GET /compute/v2.1/servers/54d2f913-8385-4f34-8cb0-8c0f08c7a30f => generated 1516 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:46:39.486547 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-6d818f9a-5b7e-421c-b7ef-53a0cd3018b8 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:46:39.487504 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-6d818f9a-5b7e-421c-b7ef-53a0cd3018b8 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] [instance: a99a6a98-4010-4f8e-a83f-fcc490f6ece0] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:46:39.497865 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-6d818f9a-5b7e-421c-b7ef-53a0cd3018b8 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:39.498699 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-6d818f9a-5b7e-421c-b7ef-53a0cd3018b8 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:39.499921 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-6d818f9a-5b7e-421c-b7ef-53a0cd3018b8 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:39.500752 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-6d818f9a-5b7e-421c-b7ef-53a0cd3018b8 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:39.594048 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-6d818f9a-5b7e-421c-b7ef-53a0cd3018b8 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] 10.222.0.30 "POST /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0/action" status: 200 len: 28614 microversion: 2.20 time: 0.111599 Dec 24 10:46:39.599991 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 141/285] 10.222.0.30 () {62 vars in 1318 bytes} [Fri Dec 24 10:46:39 2021] POST /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0/action => generated 28614 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 24 10:46:39.649862 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-a5849816-3748-4238-8908-b855b2a2b69e tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37516225f9244c969ed168f6a024482a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0115a5cc8b4b1e8bffb84e0f3e0b08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:46:39.657373 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-a5849816-3748-4238-8908-b855b2a2b69e tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] 10.222.0.30 "GET /compute/v2.1/servers/9330dbb8-edad-4d54-afeb-8badc464250d" status: 200 len: 1363 microversion: 2.1 time: 0.260423 Dec 24 10:46:39.658301 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 145/286] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:46:39 2021] GET /compute/v2.1/servers/9330dbb8-edad-4d54-afeb-8badc464250d => generated 1363 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:46:39.961082 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-cd05264c-c723-426a-bb90-328984c5a880 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:46:39.961801 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-cd05264c-c723-426a-bb90-328984c5a880 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] [instance: fb8d3af9-4513-4f65-8863-0f910fd46f04] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:46:39.969524 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-cd05264c-c723-426a-bb90-328984c5a880 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:39.969975 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-cd05264c-c723-426a-bb90-328984c5a880 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:39.970755 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-cd05264c-c723-426a-bb90-328984c5a880 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:39.971183 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-cd05264c-c723-426a-bb90-328984c5a880 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:40.041716 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-cd05264c-c723-426a-bb90-328984c5a880 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ad5096717dc425c849dfe95ea55a6af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62d11172cdf4959a15ac1ffc5601aca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:46:40.050959 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-cd05264c-c723-426a-bb90-328984c5a880 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] 10.222.0.30 "GET /compute/v2.1/servers/fb8d3af9-4513-4f65-8863-0f910fd46f04" status: 200 len: 1270 microversion: 2.1 time: 0.094234 Dec 24 10:46:40.051819 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 142/287] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:46:39 2021] GET /compute/v2.1/servers/fb8d3af9-4513-4f65-8863-0f910fd46f04 => generated 1270 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:46:40.606858 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-1a2e2cb5-2fd5-4991-aba1-4b8a000306c5 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:46:40.607813 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-1a2e2cb5-2fd5-4991-aba1-4b8a000306c5 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] [instance: a99a6a98-4010-4f8e-a83f-fcc490f6ece0] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:46:40.614618 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-1a2e2cb5-2fd5-4991-aba1-4b8a000306c5 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:40.615028 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-1a2e2cb5-2fd5-4991-aba1-4b8a000306c5 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:40.630310 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-1a2e2cb5-2fd5-4991-aba1-4b8a000306c5 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:40.630736 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-1a2e2cb5-2fd5-4991-aba1-4b8a000306c5 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:40.675437 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-2eded6b1-1f20-4119-a151-d756e533083b tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:46:40.677275 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-2eded6b1-1f20-4119-a151-d756e533083b tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] [instance: 9330dbb8-edad-4d54-afeb-8badc464250d] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:46:40.686403 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-2eded6b1-1f20-4119-a151-d756e533083b tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:40.689734 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-2eded6b1-1f20-4119-a151-d756e533083b tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:40.692781 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-2eded6b1-1f20-4119-a151-d756e533083b tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:40.697186 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-2eded6b1-1f20-4119-a151-d756e533083b tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:40.753061 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-1a2e2cb5-2fd5-4991-aba1-4b8a000306c5 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] 10.222.0.30 "POST /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0/action" status: 200 len: 28614 microversion: 2.20 time: 0.149739 Dec 24 10:46:40.753731 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 146/288] 10.222.0.30 () {62 vars in 1318 bytes} [Fri Dec 24 10:46:40 2021] POST /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0/action => generated 28614 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 24 10:46:40.947861 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-2eded6b1-1f20-4119-a151-d756e533083b tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37516225f9244c969ed168f6a024482a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0115a5cc8b4b1e8bffb84e0f3e0b08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:46:40.955566 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-2eded6b1-1f20-4119-a151-d756e533083b tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] 10.222.0.30 "GET /compute/v2.1/servers/9330dbb8-edad-4d54-afeb-8badc464250d" status: 200 len: 1363 microversion: 2.1 time: 0.283968 Dec 24 10:46:40.956347 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 143/289] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:46:40 2021] GET /compute/v2.1/servers/9330dbb8-edad-4d54-afeb-8badc464250d => generated 1363 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:46:41.071450 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-d4f7ede6-dff1-4a94-b96e-1ac8119820aa tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:46:41.072350 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-d4f7ede6-dff1-4a94-b96e-1ac8119820aa tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] [instance: fb8d3af9-4513-4f65-8863-0f910fd46f04] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:46:41.086358 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-d4f7ede6-dff1-4a94-b96e-1ac8119820aa tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:41.086980 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-d4f7ede6-dff1-4a94-b96e-1ac8119820aa tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:41.087918 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-d4f7ede6-dff1-4a94-b96e-1ac8119820aa tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:41.088699 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-d4f7ede6-dff1-4a94-b96e-1ac8119820aa tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:41.158894 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-d4f7ede6-dff1-4a94-b96e-1ac8119820aa tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ad5096717dc425c849dfe95ea55a6af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62d11172cdf4959a15ac1ffc5601aca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:46:41.167402 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-d4f7ede6-dff1-4a94-b96e-1ac8119820aa tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] 10.222.0.30 "GET /compute/v2.1/servers/fb8d3af9-4513-4f65-8863-0f910fd46f04" status: 200 len: 1276 microversion: 2.1 time: 0.100818 Dec 24 10:46:41.168112 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 147/290] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:46:41 2021] GET /compute/v2.1/servers/fb8d3af9-4513-4f65-8863-0f910fd46f04 => generated 1276 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:46:41.332227 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-c2b6a531-c4b8-41ad-bc9e-8039c0a1d208 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:46:41.333193 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-c2b6a531-c4b8-41ad-bc9e-8039c0a1d208 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] [instance: 54d2f913-8385-4f34-8cb0-8c0f08c7a30f] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:46:41.340422 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-c2b6a531-c4b8-41ad-bc9e-8039c0a1d208 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:41.340895 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-c2b6a531-c4b8-41ad-bc9e-8039c0a1d208 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:41.341726 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-c2b6a531-c4b8-41ad-bc9e-8039c0a1d208 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:41.342553 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-c2b6a531-c4b8-41ad-bc9e-8039c0a1d208 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:41.371846 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.objects.instance [None req-c2b6a531-c4b8-41ad-bc9e-8039c0a1d208 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lazy-loading 'flavor' on Instance uuid 54d2f913-8385-4f34-8cb0-8c0f08c7a30f {{(pid=123432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 24 10:46:41.773600 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-bce00453-ce65-4127-a38d-f29624dc628a tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:46:41.774563 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-bce00453-ce65-4127-a38d-f29624dc628a tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] [instance: a99a6a98-4010-4f8e-a83f-fcc490f6ece0] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:46:41.787575 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-c2b6a531-c4b8-41ad-bc9e-8039c0a1d208 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] 10.222.0.30 "POST /compute/v2.1/servers/54d2f913-8385-4f34-8cb0-8c0f08c7a30f/action" status: 200 len: 32 microversion: 2.1 time: 0.445859 Dec 24 10:46:41.788266 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 144/291] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Dec 24 10:46:41 2021] POST /compute/v2.1/servers/54d2f913-8385-4f34-8cb0-8c0f08c7a30f/action => generated 32 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 24 10:46:41.839215 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-e4ed05e9-ac37-4ee9-9285-3aef941bf9e8 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:46:41.841866 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-e4ed05e9-ac37-4ee9-9285-3aef941bf9e8 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] [instance: 54d2f913-8385-4f34-8cb0-8c0f08c7a30f] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:46:41.842523 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-bce00453-ce65-4127-a38d-f29624dc628a tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:41.842523 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-bce00453-ce65-4127-a38d-f29624dc628a tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:41.843596 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-bce00453-ce65-4127-a38d-f29624dc628a tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:41.844027 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-bce00453-ce65-4127-a38d-f29624dc628a tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:41.855725 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-e4ed05e9-ac37-4ee9-9285-3aef941bf9e8 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:41.856395 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-e4ed05e9-ac37-4ee9-9285-3aef941bf9e8 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:41.858381 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-e4ed05e9-ac37-4ee9-9285-3aef941bf9e8 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:41.860364 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-e4ed05e9-ac37-4ee9-9285-3aef941bf9e8 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:41.963289 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-bce00453-ce65-4127-a38d-f29624dc628a tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] 10.222.0.30 "POST /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0/action" status: 200 len: 28614 microversion: 2.20 time: 0.200848 Dec 24 10:46:41.965020 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 148/292] 10.222.0.30 () {62 vars in 1318 bytes} [Fri Dec 24 10:46:41 2021] POST /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0/action => generated 28614 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 24 10:46:41.978170 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-8a79a23e-8aef-4cc5-a58d-6b86e01afa5d tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:46:41.993886 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-8a79a23e-8aef-4cc5-a58d-6b86e01afa5d tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] [instance: 9330dbb8-edad-4d54-afeb-8badc464250d] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:46:42.007878 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-8a79a23e-8aef-4cc5-a58d-6b86e01afa5d tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:42.008553 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-8a79a23e-8aef-4cc5-a58d-6b86e01afa5d tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:42.009526 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-8a79a23e-8aef-4cc5-a58d-6b86e01afa5d tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:42.010221 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-8a79a23e-8aef-4cc5-a58d-6b86e01afa5d tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:42.256485 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-e4ed05e9-ac37-4ee9-9285-3aef941bf9e8 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d627b760f74f48ac560e2ce2e74e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '378bb44ad89440e49f7e290a5d31004e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:46:42.271374 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-e4ed05e9-ac37-4ee9-9285-3aef941bf9e8 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] 10.222.0.30 "GET /compute/v2.1/servers/54d2f913-8385-4f34-8cb0-8c0f08c7a30f" status: 200 len: 1522 microversion: 2.1 time: 0.471653 Dec 24 10:46:42.272261 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 145/293] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:46:41 2021] GET /compute/v2.1/servers/54d2f913-8385-4f34-8cb0-8c0f08c7a30f => generated 1522 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:46:42.277315 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-29fc6539-e249-4d42-98d9-c474145fb81f tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:46:42.278406 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-29fc6539-e249-4d42-98d9-c474145fb81f tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] [instance: fb8d3af9-4513-4f65-8863-0f910fd46f04] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:46:42.288177 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-29fc6539-e249-4d42-98d9-c474145fb81f tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:42.289016 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-29fc6539-e249-4d42-98d9-c474145fb81f tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:42.290464 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-29fc6539-e249-4d42-98d9-c474145fb81f tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:42.291139 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-29fc6539-e249-4d42-98d9-c474145fb81f tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:42.320271 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-8a79a23e-8aef-4cc5-a58d-6b86e01afa5d tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37516225f9244c969ed168f6a024482a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0115a5cc8b4b1e8bffb84e0f3e0b08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:46:42.328215 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-8a79a23e-8aef-4cc5-a58d-6b86e01afa5d tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] 10.222.0.30 "GET /compute/v2.1/servers/9330dbb8-edad-4d54-afeb-8badc464250d" status: 200 len: 1363 microversion: 2.1 time: 0.358557 Dec 24 10:46:42.328796 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 149/294] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:46:41 2021] GET /compute/v2.1/servers/9330dbb8-edad-4d54-afeb-8badc464250d => generated 1363 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 24 10:46:42.603650 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-29fc6539-e249-4d42-98d9-c474145fb81f tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ad5096717dc425c849dfe95ea55a6af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62d11172cdf4959a15ac1ffc5601aca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:46:42.611035 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-29fc6539-e249-4d42-98d9-c474145fb81f tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] 10.222.0.30 "GET /compute/v2.1/servers/fb8d3af9-4513-4f65-8863-0f910fd46f04" status: 200 len: 1318 microversion: 2.1 time: 0.337559 Dec 24 10:46:42.611691 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 146/295] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:46:42 2021] GET /compute/v2.1/servers/fb8d3af9-4513-4f65-8863-0f910fd46f04 => generated 1318 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:46:42.748304 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [req-02831ffc-6c7e-4e1c-adcb-06190c7ec9eb req-c64ab4e8-2746-4299-902c-229090599519 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fb8d3af9-4513-4f65-8863-0f910fd46f04", "tag": "eb607d9e-2e93-47a0-8ad5-4d68c6faaa44"}]} {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:46:42.750199 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 10:46:42.750199 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: warnings.warn(msg) Dec 24 10:46:42.759320 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [req-02831ffc-6c7e-4e1c-adcb-06190c7ec9eb req-c64ab4e8-2746-4299-902c-229090599519 service nova] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:42.759767 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [req-02831ffc-6c7e-4e1c-adcb-06190c7ec9eb req-c64ab4e8-2746-4299-902c-229090599519 service nova] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:42.786636 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.compute.server_external_events [req-02831ffc-6c7e-4e1c-adcb-06190c7ec9eb req-c64ab4e8-2746-4299-902c-229090599519 service nova] Creating event network-changed:eb607d9e-2e93-47a0-8ad5-4d68c6faaa44 for instance fb8d3af9-4513-4f65-8863-0f910fd46f04 on hv-cinder-81644 Dec 24 10:46:42.791867 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [req-02831ffc-6c7e-4e1c-adcb-06190c7ec9eb req-c64ab4e8-2746-4299-902c-229090599519 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048563 Dec 24 10:46:42.793475 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 150/296] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Dec 24 10:46:42 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 10:46:42.974879 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-f6340de2-1205-4bc6-8581-405a90ce3336 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:46:42.975847 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-f6340de2-1205-4bc6-8581-405a90ce3336 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] [instance: a99a6a98-4010-4f8e-a83f-fcc490f6ece0] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:46:42.994237 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-f6340de2-1205-4bc6-8581-405a90ce3336 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:42.995044 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-f6340de2-1205-4bc6-8581-405a90ce3336 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:42.995665 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-f6340de2-1205-4bc6-8581-405a90ce3336 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:42.996098 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-f6340de2-1205-4bc6-8581-405a90ce3336 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:43.175080 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-f6340de2-1205-4bc6-8581-405a90ce3336 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] 10.222.0.30 "POST /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0/action" status: 200 len: 28731 microversion: 2.20 time: 0.203869 Dec 24 10:46:43.176317 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 147/297] 10.222.0.30 () {62 vars in 1318 bytes} [Fri Dec 24 10:46:42 2021] POST /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0/action => generated 28731 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 24 10:46:43.290044 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-c01f3a04-5088-43bd-aaf7-5edb17ad74aa tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:46:43.290789 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-c01f3a04-5088-43bd-aaf7-5edb17ad74aa tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] [instance: 54d2f913-8385-4f34-8cb0-8c0f08c7a30f] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:46:43.297278 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-c01f3a04-5088-43bd-aaf7-5edb17ad74aa tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:43.297458 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-c01f3a04-5088-43bd-aaf7-5edb17ad74aa tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:43.298248 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-c01f3a04-5088-43bd-aaf7-5edb17ad74aa tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:43.298681 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-c01f3a04-5088-43bd-aaf7-5edb17ad74aa tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:43.347006 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-490de1e4-60fb-4116-b1f8-55be1fc01d52 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:46:43.348301 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-490de1e4-60fb-4116-b1f8-55be1fc01d52 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] [instance: 9330dbb8-edad-4d54-afeb-8badc464250d] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:46:43.362513 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-490de1e4-60fb-4116-b1f8-55be1fc01d52 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:43.362959 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-490de1e4-60fb-4116-b1f8-55be1fc01d52 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:43.364098 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-490de1e4-60fb-4116-b1f8-55be1fc01d52 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:43.366093 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-490de1e4-60fb-4116-b1f8-55be1fc01d52 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:43.485649 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-c01f3a04-5088-43bd-aaf7-5edb17ad74aa tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d627b760f74f48ac560e2ce2e74e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '378bb44ad89440e49f7e290a5d31004e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:46:43.493037 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-c01f3a04-5088-43bd-aaf7-5edb17ad74aa tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] 10.222.0.30 "GET /compute/v2.1/servers/54d2f913-8385-4f34-8cb0-8c0f08c7a30f" status: 200 len: 1522 microversion: 2.1 time: 0.207411 Dec 24 10:46:43.493706 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 151/298] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:46:43 2021] GET /compute/v2.1/servers/54d2f913-8385-4f34-8cb0-8c0f08c7a30f => generated 1522 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:46:43.627189 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-d75899d4-1a59-4bf1-8090-da01d51adfb8 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:46:43.627794 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-d75899d4-1a59-4bf1-8090-da01d51adfb8 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] [instance: fb8d3af9-4513-4f65-8863-0f910fd46f04] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:46:43.634570 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-d75899d4-1a59-4bf1-8090-da01d51adfb8 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:43.635232 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-d75899d4-1a59-4bf1-8090-da01d51adfb8 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:43.636180 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-d75899d4-1a59-4bf1-8090-da01d51adfb8 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:43.636616 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-d75899d4-1a59-4bf1-8090-da01d51adfb8 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:43.685965 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-490de1e4-60fb-4116-b1f8-55be1fc01d52 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37516225f9244c969ed168f6a024482a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0115a5cc8b4b1e8bffb84e0f3e0b08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:46:43.694365 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-490de1e4-60fb-4116-b1f8-55be1fc01d52 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] 10.222.0.30 "GET /compute/v2.1/servers/9330dbb8-edad-4d54-afeb-8badc464250d" status: 200 len: 1363 microversion: 2.1 time: 0.352145 Dec 24 10:46:43.695196 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 148/299] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:46:43 2021] GET /compute/v2.1/servers/9330dbb8-edad-4d54-afeb-8badc464250d => generated 1363 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:46:43.838806 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-d75899d4-1a59-4bf1-8090-da01d51adfb8 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ad5096717dc425c849dfe95ea55a6af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62d11172cdf4959a15ac1ffc5601aca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:46:43.853072 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-d75899d4-1a59-4bf1-8090-da01d51adfb8 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] 10.222.0.30 "GET /compute/v2.1/servers/fb8d3af9-4513-4f65-8863-0f910fd46f04" status: 200 len: 1318 microversion: 2.1 time: 0.229187 Dec 24 10:46:43.864860 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 152/300] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:46:43 2021] GET /compute/v2.1/servers/fb8d3af9-4513-4f65-8863-0f910fd46f04 => generated 1318 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 24 10:46:44.188569 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-20eb908e-d8d3-4b5a-9484-32b8b0b09f59 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:46:44.190048 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-20eb908e-d8d3-4b5a-9484-32b8b0b09f59 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] [instance: a99a6a98-4010-4f8e-a83f-fcc490f6ece0] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:46:44.207419 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-20eb908e-d8d3-4b5a-9484-32b8b0b09f59 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:44.208330 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-20eb908e-d8d3-4b5a-9484-32b8b0b09f59 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:44.209834 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-20eb908e-d8d3-4b5a-9484-32b8b0b09f59 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:44.210512 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-20eb908e-d8d3-4b5a-9484-32b8b0b09f59 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:44.286042 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [req-2655b6be-94c5-44d6-85b8-135d44302206 req-a0f30446-cdcf-4b88-a436-6751abc9b1b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9330dbb8-edad-4d54-afeb-8badc464250d", "name": "network-vif-plugged", "status": "completed", "tag": "0cea520e-6ec2-4fe3-8f62-bfb44b96b73e"}]} {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:46:44.287796 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 10:46:44.287796 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: warnings.warn(msg) Dec 24 10:46:44.296335 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [req-2655b6be-94c5-44d6-85b8-135d44302206 req-a0f30446-cdcf-4b88-a436-6751abc9b1b5 service nova] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:44.296779 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [req-2655b6be-94c5-44d6-85b8-135d44302206 req-a0f30446-cdcf-4b88-a436-6751abc9b1b5 service nova] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:44.316175 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.compute.server_external_events [req-2655b6be-94c5-44d6-85b8-135d44302206 req-a0f30446-cdcf-4b88-a436-6751abc9b1b5 service nova] Creating event network-vif-plugged:0cea520e-6ec2-4fe3-8f62-bfb44b96b73e for instance 9330dbb8-edad-4d54-afeb-8badc464250d on hv-cinder-81644 Dec 24 10:46:44.316175 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [req-2655b6be-94c5-44d6-85b8-135d44302206 req-a0f30446-cdcf-4b88-a436-6751abc9b1b5 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032145 Dec 24 10:46:44.316175 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 153/301] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Dec 24 10:46:44 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 24 10:46:44.322013 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-20eb908e-d8d3-4b5a-9484-32b8b0b09f59 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] 10.222.0.30 "POST /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0/action" status: 200 len: 29586 microversion: 2.20 time: 0.139098 Dec 24 10:46:44.327272 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 149/302] 10.222.0.30 () {62 vars in 1318 bytes} [Fri Dec 24 10:46:44 2021] POST /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0/action => generated 29586 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 24 10:46:44.510302 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-d6cb2bfb-a9d1-4761-b519-9407edc72b71 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:46:44.510988 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-d6cb2bfb-a9d1-4761-b519-9407edc72b71 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] [instance: 54d2f913-8385-4f34-8cb0-8c0f08c7a30f] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:46:44.517105 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-d6cb2bfb-a9d1-4761-b519-9407edc72b71 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:44.517595 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-d6cb2bfb-a9d1-4761-b519-9407edc72b71 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:44.518679 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-d6cb2bfb-a9d1-4761-b519-9407edc72b71 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:44.518937 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-d6cb2bfb-a9d1-4761-b519-9407edc72b71 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:44.656204 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-d6cb2bfb-a9d1-4761-b519-9407edc72b71 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d627b760f74f48ac560e2ce2e74e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '378bb44ad89440e49f7e290a5d31004e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:46:44.668964 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-d6cb2bfb-a9d1-4761-b519-9407edc72b71 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] 10.222.0.30 "GET /compute/v2.1/servers/54d2f913-8385-4f34-8cb0-8c0f08c7a30f" status: 200 len: 1522 microversion: 2.1 time: 0.161470 Dec 24 10:46:44.679974 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 154/303] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:46:44 2021] GET /compute/v2.1/servers/54d2f913-8385-4f34-8cb0-8c0f08c7a30f => generated 1522 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:46:44.711626 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-10c6d6a3-fdf6-400d-ab01-f20589255419 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:46:44.712682 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-10c6d6a3-fdf6-400d-ab01-f20589255419 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] [instance: 9330dbb8-edad-4d54-afeb-8badc464250d] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:46:44.720475 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-10c6d6a3-fdf6-400d-ab01-f20589255419 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:44.721054 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-10c6d6a3-fdf6-400d-ab01-f20589255419 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:44.726408 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-10c6d6a3-fdf6-400d-ab01-f20589255419 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:44.726408 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-10c6d6a3-fdf6-400d-ab01-f20589255419 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:44.873357 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-fddc3871-f800-412f-be2a-e1f2f4ee986c tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:46:44.874058 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-fddc3871-f800-412f-be2a-e1f2f4ee986c tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] [instance: fb8d3af9-4513-4f65-8863-0f910fd46f04] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:46:44.886988 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-fddc3871-f800-412f-be2a-e1f2f4ee986c tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:44.889234 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-fddc3871-f800-412f-be2a-e1f2f4ee986c tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:44.890372 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-fddc3871-f800-412f-be2a-e1f2f4ee986c tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:44.890964 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-fddc3871-f800-412f-be2a-e1f2f4ee986c tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:44.897431 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-10c6d6a3-fdf6-400d-ab01-f20589255419 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37516225f9244c969ed168f6a024482a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0115a5cc8b4b1e8bffb84e0f3e0b08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:46:44.905533 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-10c6d6a3-fdf6-400d-ab01-f20589255419 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] 10.222.0.30 "GET /compute/v2.1/servers/9330dbb8-edad-4d54-afeb-8badc464250d" status: 200 len: 1363 microversion: 2.1 time: 0.198042 Dec 24 10:46:44.906071 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 150/304] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:46:44 2021] GET /compute/v2.1/servers/9330dbb8-edad-4d54-afeb-8badc464250d => generated 1363 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:46:45.089685 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-fddc3871-f800-412f-be2a-e1f2f4ee986c tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ad5096717dc425c849dfe95ea55a6af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62d11172cdf4959a15ac1ffc5601aca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:46:45.097229 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-fddc3871-f800-412f-be2a-e1f2f4ee986c tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] 10.222.0.30 "GET /compute/v2.1/servers/fb8d3af9-4513-4f65-8863-0f910fd46f04" status: 200 len: 1318 microversion: 2.1 time: 0.229158 Dec 24 10:46:45.099896 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 155/305] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:46:44 2021] GET /compute/v2.1/servers/fb8d3af9-4513-4f65-8863-0f910fd46f04 => generated 1318 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:46:45.334591 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-5650925e-fc92-4d15-91db-07c59861147e tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:46:45.335664 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-5650925e-fc92-4d15-91db-07c59861147e tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] [instance: a99a6a98-4010-4f8e-a83f-fcc490f6ece0] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:46:45.342368 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-5650925e-fc92-4d15-91db-07c59861147e tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:45.342811 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-5650925e-fc92-4d15-91db-07c59861147e tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:45.343599 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-5650925e-fc92-4d15-91db-07c59861147e tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:45.344016 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-5650925e-fc92-4d15-91db-07c59861147e tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:45.453305 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-5650925e-fc92-4d15-91db-07c59861147e tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] 10.222.0.30 "POST /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0/action" status: 200 len: 30946 microversion: 2.20 time: 0.122721 Dec 24 10:46:45.454260 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 151/306] 10.222.0.30 () {62 vars in 1318 bytes} [Fri Dec 24 10:46:45 2021] POST /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0/action => generated 30946 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 24 10:46:45.699449 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-c1fbf809-bf5a-4cd9-8a66-340b80c27540 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:46:45.700243 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-c1fbf809-bf5a-4cd9-8a66-340b80c27540 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] [instance: 54d2f913-8385-4f34-8cb0-8c0f08c7a30f] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:46:45.706547 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-c1fbf809-bf5a-4cd9-8a66-340b80c27540 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:45.707033 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-c1fbf809-bf5a-4cd9-8a66-340b80c27540 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:45.707818 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-c1fbf809-bf5a-4cd9-8a66-340b80c27540 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:45.708261 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-c1fbf809-bf5a-4cd9-8a66-340b80c27540 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:45.912630 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-c1fbf809-bf5a-4cd9-8a66-340b80c27540 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d627b760f74f48ac560e2ce2e74e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '378bb44ad89440e49f7e290a5d31004e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:46:45.926039 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-98607d6f-deb0-4d65-a7d1-bd31ec695f1f tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:46:45.927056 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-98607d6f-deb0-4d65-a7d1-bd31ec695f1f tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] [instance: 9330dbb8-edad-4d54-afeb-8badc464250d] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:46:45.932994 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-c1fbf809-bf5a-4cd9-8a66-340b80c27540 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] 10.222.0.30 "GET /compute/v2.1/servers/54d2f913-8385-4f34-8cb0-8c0f08c7a30f" status: 200 len: 1522 microversion: 2.1 time: 0.224703 Dec 24 10:46:45.933790 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 156/307] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:46:45 2021] GET /compute/v2.1/servers/54d2f913-8385-4f34-8cb0-8c0f08c7a30f => generated 1522 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 24 10:46:45.934292 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-98607d6f-deb0-4d65-a7d1-bd31ec695f1f tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:45.935019 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-98607d6f-deb0-4d65-a7d1-bd31ec695f1f tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:45.935974 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-98607d6f-deb0-4d65-a7d1-bd31ec695f1f tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:45.936610 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-98607d6f-deb0-4d65-a7d1-bd31ec695f1f tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:46.086462 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-98607d6f-deb0-4d65-a7d1-bd31ec695f1f tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37516225f9244c969ed168f6a024482a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0115a5cc8b4b1e8bffb84e0f3e0b08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:46:46.091274 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-98607d6f-deb0-4d65-a7d1-bd31ec695f1f tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] 10.222.0.30 "GET /compute/v2.1/servers/9330dbb8-edad-4d54-afeb-8badc464250d" status: 200 len: 1363 microversion: 2.1 time: 0.169183 Dec 24 10:46:46.092274 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 152/308] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:46:45 2021] GET /compute/v2.1/servers/9330dbb8-edad-4d54-afeb-8badc464250d => generated 1363 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:46:46.117879 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-7035661f-d8c7-4acf-bd79-629f5b5f0bca tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:46:46.118923 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-7035661f-d8c7-4acf-bd79-629f5b5f0bca tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] [instance: fb8d3af9-4513-4f65-8863-0f910fd46f04] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:46:46.127587 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-7035661f-d8c7-4acf-bd79-629f5b5f0bca tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:46.132061 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-7035661f-d8c7-4acf-bd79-629f5b5f0bca tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:46.133911 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-7035661f-d8c7-4acf-bd79-629f5b5f0bca tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:46.134504 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-7035661f-d8c7-4acf-bd79-629f5b5f0bca tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:46.368348 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-7035661f-d8c7-4acf-bd79-629f5b5f0bca tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ad5096717dc425c849dfe95ea55a6af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62d11172cdf4959a15ac1ffc5601aca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:46:46.377926 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-7035661f-d8c7-4acf-bd79-629f5b5f0bca tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] 10.222.0.30 "GET /compute/v2.1/servers/fb8d3af9-4513-4f65-8863-0f910fd46f04" status: 200 len: 1318 microversion: 2.1 time: 0.263346 Dec 24 10:46:46.389080 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 157/309] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:46:46 2021] GET /compute/v2.1/servers/fb8d3af9-4513-4f65-8863-0f910fd46f04 => generated 1318 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:46:46.465594 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-ccb14999-38e1-4841-9918-f83fbbfccfb9 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:46:46.466950 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-ccb14999-38e1-4841-9918-f83fbbfccfb9 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] [instance: a99a6a98-4010-4f8e-a83f-fcc490f6ece0] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:46:46.473683 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-ccb14999-38e1-4841-9918-f83fbbfccfb9 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:46.474126 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-ccb14999-38e1-4841-9918-f83fbbfccfb9 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:46.474991 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-ccb14999-38e1-4841-9918-f83fbbfccfb9 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:46.475438 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-ccb14999-38e1-4841-9918-f83fbbfccfb9 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:46.591604 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-ccb14999-38e1-4841-9918-f83fbbfccfb9 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] 10.222.0.30 "POST /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0/action" status: 200 len: 31643 microversion: 2.20 time: 0.129723 Dec 24 10:46:46.593538 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 153/310] 10.222.0.30 () {62 vars in 1318 bytes} [Fri Dec 24 10:46:46 2021] POST /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0/action => generated 31643 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 24 10:46:46.950993 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-b9abaab8-8ab7-4637-bf61-d5c8cd9dd48d tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:46:46.951597 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-b9abaab8-8ab7-4637-bf61-d5c8cd9dd48d tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] [instance: 54d2f913-8385-4f34-8cb0-8c0f08c7a30f] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:46:46.958765 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-b9abaab8-8ab7-4637-bf61-d5c8cd9dd48d tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:46.959210 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-b9abaab8-8ab7-4637-bf61-d5c8cd9dd48d tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:46.960211 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-b9abaab8-8ab7-4637-bf61-d5c8cd9dd48d tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:46.960966 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-b9abaab8-8ab7-4637-bf61-d5c8cd9dd48d tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:47.110833 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-0e95a8b7-be74-4302-9f1b-eeae4198225b tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:46:47.113518 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-0e95a8b7-be74-4302-9f1b-eeae4198225b tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] [instance: 9330dbb8-edad-4d54-afeb-8badc464250d] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:46:47.124930 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-0e95a8b7-be74-4302-9f1b-eeae4198225b tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:47.126490 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-0e95a8b7-be74-4302-9f1b-eeae4198225b tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:47.129594 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-0e95a8b7-be74-4302-9f1b-eeae4198225b tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:47.130039 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-0e95a8b7-be74-4302-9f1b-eeae4198225b tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:47.245726 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-b9abaab8-8ab7-4637-bf61-d5c8cd9dd48d tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d627b760f74f48ac560e2ce2e74e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '378bb44ad89440e49f7e290a5d31004e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:46:47.254756 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-b9abaab8-8ab7-4637-bf61-d5c8cd9dd48d tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] 10.222.0.30 "GET /compute/v2.1/servers/54d2f913-8385-4f34-8cb0-8c0f08c7a30f" status: 200 len: 1522 microversion: 2.1 time: 0.306966 Dec 24 10:46:47.268032 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 158/311] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:46:46 2021] GET /compute/v2.1/servers/54d2f913-8385-4f34-8cb0-8c0f08c7a30f => generated 1522 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:46:47.305548 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-0e95a8b7-be74-4302-9f1b-eeae4198225b tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37516225f9244c969ed168f6a024482a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0115a5cc8b4b1e8bffb84e0f3e0b08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:46:47.313421 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-0e95a8b7-be74-4302-9f1b-eeae4198225b tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] 10.222.0.30 "GET /compute/v2.1/servers/9330dbb8-edad-4d54-afeb-8badc464250d" status: 200 len: 1549 microversion: 2.1 time: 0.208393 Dec 24 10:46:47.313993 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 154/312] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:46:47 2021] GET /compute/v2.1/servers/9330dbb8-edad-4d54-afeb-8badc464250d => generated 1549 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 24 10:46:47.332797 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-680776a6-b05c-40b3-9eab-caee358ae246 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:46:47.333317 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-680776a6-b05c-40b3-9eab-caee358ae246 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] [instance: 9330dbb8-edad-4d54-afeb-8badc464250d] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:46:47.339113 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-680776a6-b05c-40b3-9eab-caee358ae246 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:47.340031 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-680776a6-b05c-40b3-9eab-caee358ae246 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:47.340334 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-680776a6-b05c-40b3-9eab-caee358ae246 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:47.341250 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-680776a6-b05c-40b3-9eab-caee358ae246 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:47.398516 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-28432475-c94b-4ecf-ae1f-ff64b2454b11 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:46:47.399129 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-28432475-c94b-4ecf-ae1f-ff64b2454b11 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] [instance: fb8d3af9-4513-4f65-8863-0f910fd46f04] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:46:47.406084 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-28432475-c94b-4ecf-ae1f-ff64b2454b11 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:47.409721 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-28432475-c94b-4ecf-ae1f-ff64b2454b11 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:47.409721 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-28432475-c94b-4ecf-ae1f-ff64b2454b11 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:47.409721 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-28432475-c94b-4ecf-ae1f-ff64b2454b11 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:47.536635 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-680776a6-b05c-40b3-9eab-caee358ae246 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] 10.222.0.30 "GET /compute/v2.1/servers/9330dbb8-edad-4d54-afeb-8badc464250d/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.207796 Dec 24 10:46:47.543423 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 159/313] 10.222.0.30 () {58 vars in 1274 bytes} [Fri Dec 24 10:46:47 2021] GET /compute/v2.1/servers/9330dbb8-edad-4d54-afeb-8badc464250d/os-interface => generated 284 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 10:46:47.585840 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-28432475-c94b-4ecf-ae1f-ff64b2454b11 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ad5096717dc425c849dfe95ea55a6af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62d11172cdf4959a15ac1ffc5601aca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:46:47.593757 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-28432475-c94b-4ecf-ae1f-ff64b2454b11 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] 10.222.0.30 "GET /compute/v2.1/servers/fb8d3af9-4513-4f65-8863-0f910fd46f04" status: 200 len: 1318 microversion: 2.1 time: 0.201914 Dec 24 10:46:47.594339 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 155/314] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:46:47 2021] GET /compute/v2.1/servers/fb8d3af9-4513-4f65-8863-0f910fd46f04 => generated 1318 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:46:47.604049 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-32868789-0bdd-44c4-ba9e-2b886661c84a tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:46:47.605003 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-32868789-0bdd-44c4-ba9e-2b886661c84a tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] [instance: a99a6a98-4010-4f8e-a83f-fcc490f6ece0] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:46:47.611184 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-32868789-0bdd-44c4-ba9e-2b886661c84a tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:47.614419 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-32868789-0bdd-44c4-ba9e-2b886661c84a tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:47.614419 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-32868789-0bdd-44c4-ba9e-2b886661c84a tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:47.614419 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-32868789-0bdd-44c4-ba9e-2b886661c84a tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:47.707357 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-32868789-0bdd-44c4-ba9e-2b886661c84a tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] 10.222.0.30 "POST /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0/action" status: 200 len: 32415 microversion: 2.20 time: 0.106191 Dec 24 10:46:47.708032 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 160/315] 10.222.0.30 () {62 vars in 1318 bytes} [Fri Dec 24 10:46:47 2021] POST /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0/action => generated 32415 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 24 10:46:48.276644 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-dcc342bf-e5fd-49e7-8222-70995fa3929d tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:46:48.277596 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-dcc342bf-e5fd-49e7-8222-70995fa3929d tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] [instance: 54d2f913-8385-4f34-8cb0-8c0f08c7a30f] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:46:48.286978 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-dcc342bf-e5fd-49e7-8222-70995fa3929d tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:48.287625 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-dcc342bf-e5fd-49e7-8222-70995fa3929d tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:48.288524 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-dcc342bf-e5fd-49e7-8222-70995fa3929d tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:48.289126 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-dcc342bf-e5fd-49e7-8222-70995fa3929d tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:48.445908 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-dcc342bf-e5fd-49e7-8222-70995fa3929d tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d627b760f74f48ac560e2ce2e74e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '378bb44ad89440e49f7e290a5d31004e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:46:48.456469 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-dcc342bf-e5fd-49e7-8222-70995fa3929d tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] 10.222.0.30 "GET /compute/v2.1/servers/54d2f913-8385-4f34-8cb0-8c0f08c7a30f" status: 200 len: 1522 microversion: 2.1 time: 0.184529 Dec 24 10:46:48.457745 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 156/316] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:46:48 2021] GET /compute/v2.1/servers/54d2f913-8385-4f34-8cb0-8c0f08c7a30f => generated 1522 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:46:48.612029 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-15ef2b9a-8361-4f66-9014-cbb175181a44 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:46:48.612838 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-15ef2b9a-8361-4f66-9014-cbb175181a44 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] [instance: fb8d3af9-4513-4f65-8863-0f910fd46f04] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:46:48.620859 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-15ef2b9a-8361-4f66-9014-cbb175181a44 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:48.621373 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-15ef2b9a-8361-4f66-9014-cbb175181a44 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:48.622381 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-15ef2b9a-8361-4f66-9014-cbb175181a44 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:48.622743 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-15ef2b9a-8361-4f66-9014-cbb175181a44 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:48.718810 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-7b6502c8-9cb2-4b4f-956a-e62317bb3b79 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:46:48.719826 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-7b6502c8-9cb2-4b4f-956a-e62317bb3b79 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] [instance: a99a6a98-4010-4f8e-a83f-fcc490f6ece0] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:46:48.725751 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-7b6502c8-9cb2-4b4f-956a-e62317bb3b79 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:48.726424 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-7b6502c8-9cb2-4b4f-956a-e62317bb3b79 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:48.727378 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-7b6502c8-9cb2-4b4f-956a-e62317bb3b79 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:48.728131 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-7b6502c8-9cb2-4b4f-956a-e62317bb3b79 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:48.850338 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-7b6502c8-9cb2-4b4f-956a-e62317bb3b79 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] 10.222.0.30 "POST /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0/action" status: 200 len: 33047 microversion: 2.20 time: 0.135031 Dec 24 10:46:48.851679 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 157/317] 10.222.0.30 () {62 vars in 1318 bytes} [Fri Dec 24 10:46:48 2021] POST /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0/action => generated 33047 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 24 10:46:49.048993 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-15ef2b9a-8361-4f66-9014-cbb175181a44 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ad5096717dc425c849dfe95ea55a6af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62d11172cdf4959a15ac1ffc5601aca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:46:49.063197 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-15ef2b9a-8361-4f66-9014-cbb175181a44 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] 10.222.0.30 "GET /compute/v2.1/servers/fb8d3af9-4513-4f65-8863-0f910fd46f04" status: 200 len: 1318 microversion: 2.1 time: 0.454969 Dec 24 10:46:49.063771 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 161/318] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:46:48 2021] GET /compute/v2.1/servers/fb8d3af9-4513-4f65-8863-0f910fd46f04 => generated 1318 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:46:49.475250 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-9f288f85-7efa-4ac0-9075-1c39cc470c2d tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:46:49.475853 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-9f288f85-7efa-4ac0-9075-1c39cc470c2d tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] [instance: 54d2f913-8385-4f34-8cb0-8c0f08c7a30f] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:46:49.492929 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-9f288f85-7efa-4ac0-9075-1c39cc470c2d tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:49.493379 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-9f288f85-7efa-4ac0-9075-1c39cc470c2d tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:49.494162 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-9f288f85-7efa-4ac0-9075-1c39cc470c2d tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:49.494950 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-9f288f85-7efa-4ac0-9075-1c39cc470c2d tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:49.520793 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-2abc7d3c-3f19-483d-bd9c-304f1ce6c306 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:46:49.521995 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-2abc7d3c-3f19-483d-bd9c-304f1ce6c306 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] [instance: 9330dbb8-edad-4d54-afeb-8badc464250d] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:46:49.532436 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-2abc7d3c-3f19-483d-bd9c-304f1ce6c306 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:49.533203 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-2abc7d3c-3f19-483d-bd9c-304f1ce6c306 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:49.534458 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-2abc7d3c-3f19-483d-bd9c-304f1ce6c306 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:49.537072 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-2abc7d3c-3f19-483d-bd9c-304f1ce6c306 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:49.655496 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-2abc7d3c-3f19-483d-bd9c-304f1ce6c306 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] 10.222.0.30 "POST /compute/v2.1/servers/9330dbb8-edad-4d54-afeb-8badc464250d/action" status: 200 len: 14 microversion: 2.1 time: 0.138818 Dec 24 10:46:49.657224 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 162/319] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Dec 24 10:46:49 2021] POST /compute/v2.1/servers/9330dbb8-edad-4d54-afeb-8badc464250d/action => generated 14 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Dec 24 10:46:49.665251 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [req-83ade739-90d2-4355-888b-b62de0177a44 req-669dab94-2c32-426a-8455-3f1615f3dbd6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9330dbb8-edad-4d54-afeb-8badc464250d", "tag": "0cea520e-6ec2-4fe3-8f62-bfb44b96b73e"}]} {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:46:49.669298 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 10:46:49.669298 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: warnings.warn(msg) Dec 24 10:46:49.686989 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [req-83ade739-90d2-4355-888b-b62de0177a44 req-669dab94-2c32-426a-8455-3f1615f3dbd6 service nova] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:49.687919 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [req-83ade739-90d2-4355-888b-b62de0177a44 req-669dab94-2c32-426a-8455-3f1615f3dbd6 service nova] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:49.701900 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.compute.server_external_events [req-83ade739-90d2-4355-888b-b62de0177a44 req-669dab94-2c32-426a-8455-3f1615f3dbd6 service nova] Creating event network-changed:0cea520e-6ec2-4fe3-8f62-bfb44b96b73e for instance 9330dbb8-edad-4d54-afeb-8badc464250d on hv-cinder-81644 Dec 24 10:46:49.708876 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [req-83ade739-90d2-4355-888b-b62de0177a44 req-669dab94-2c32-426a-8455-3f1615f3dbd6 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049815 Dec 24 10:46:49.709971 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 163/320] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Dec 24 10:46:49 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 10:46:49.715557 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-9f288f85-7efa-4ac0-9075-1c39cc470c2d tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d627b760f74f48ac560e2ce2e74e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '378bb44ad89440e49f7e290a5d31004e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:46:49.723896 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-9f288f85-7efa-4ac0-9075-1c39cc470c2d tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] 10.222.0.30 "GET /compute/v2.1/servers/54d2f913-8385-4f34-8cb0-8c0f08c7a30f" status: 200 len: 1522 microversion: 2.1 time: 0.252616 Dec 24 10:46:49.725554 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 158/321] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:46:49 2021] GET /compute/v2.1/servers/54d2f913-8385-4f34-8cb0-8c0f08c7a30f => generated 1522 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:46:49.865312 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-9a7c85c6-e6f2-4ffb-a78b-69551523c98a tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:46:49.866069 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-9a7c85c6-e6f2-4ffb-a78b-69551523c98a tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] [instance: a99a6a98-4010-4f8e-a83f-fcc490f6ece0] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:46:49.876897 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-9a7c85c6-e6f2-4ffb-a78b-69551523c98a tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:49.877618 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-9a7c85c6-e6f2-4ffb-a78b-69551523c98a tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:49.878542 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-9a7c85c6-e6f2-4ffb-a78b-69551523c98a tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:49.888367 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-9a7c85c6-e6f2-4ffb-a78b-69551523c98a tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:50.014702 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-9a7c85c6-e6f2-4ffb-a78b-69551523c98a tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] 10.222.0.30 "POST /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0/action" status: 200 len: 33440 microversion: 2.20 time: 0.155512 Dec 24 10:46:50.018839 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 164/322] 10.222.0.30 () {62 vars in 1318 bytes} [Fri Dec 24 10:46:49 2021] POST /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0/action => generated 33440 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 24 10:46:50.080230 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-f4f2e7cf-3b9d-4d23-b08b-4044d1f904c0 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:46:50.081049 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-f4f2e7cf-3b9d-4d23-b08b-4044d1f904c0 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] [instance: fb8d3af9-4513-4f65-8863-0f910fd46f04] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:46:50.093623 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-f4f2e7cf-3b9d-4d23-b08b-4044d1f904c0 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:50.094077 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-f4f2e7cf-3b9d-4d23-b08b-4044d1f904c0 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:50.094878 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-f4f2e7cf-3b9d-4d23-b08b-4044d1f904c0 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:50.095305 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-f4f2e7cf-3b9d-4d23-b08b-4044d1f904c0 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:50.612364 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-f4f2e7cf-3b9d-4d23-b08b-4044d1f904c0 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ad5096717dc425c849dfe95ea55a6af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62d11172cdf4959a15ac1ffc5601aca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:46:50.626269 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-f4f2e7cf-3b9d-4d23-b08b-4044d1f904c0 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] 10.222.0.30 "GET /compute/v2.1/servers/fb8d3af9-4513-4f65-8863-0f910fd46f04" status: 200 len: 1318 microversion: 2.1 time: 0.549866 Dec 24 10:46:50.627048 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 159/323] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:46:50 2021] GET /compute/v2.1/servers/fb8d3af9-4513-4f65-8863-0f910fd46f04 => generated 1318 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:46:50.668024 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-f0ad917a-8e48-4984-a434-381a449119a8 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:46:50.669696 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-f0ad917a-8e48-4984-a434-381a449119a8 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] [instance: 9330dbb8-edad-4d54-afeb-8badc464250d] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:46:50.676963 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-f0ad917a-8e48-4984-a434-381a449119a8 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:50.677514 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-f0ad917a-8e48-4984-a434-381a449119a8 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:50.678212 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-f0ad917a-8e48-4984-a434-381a449119a8 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:50.678814 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-f0ad917a-8e48-4984-a434-381a449119a8 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:50.743996 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-c481249d-7850-4293-b492-798a46a247c8 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:46:50.745356 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-c481249d-7850-4293-b492-798a46a247c8 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] [instance: 54d2f913-8385-4f34-8cb0-8c0f08c7a30f] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:46:50.753145 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-c481249d-7850-4293-b492-798a46a247c8 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:50.754597 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-c481249d-7850-4293-b492-798a46a247c8 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:50.755628 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-c481249d-7850-4293-b492-798a46a247c8 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:50.756268 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-c481249d-7850-4293-b492-798a46a247c8 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:50.762823 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-f0ad917a-8e48-4984-a434-381a449119a8 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] 10.222.0.30 "POST /compute/v2.1/servers/9330dbb8-edad-4d54-afeb-8badc464250d/action" status: 200 len: 14 microversion: 2.1 time: 0.098837 Dec 24 10:46:50.763807 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 165/324] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Dec 24 10:46:50 2021] POST /compute/v2.1/servers/9330dbb8-edad-4d54-afeb-8badc464250d/action => generated 14 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 24 10:46:50.903012 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [req-a832d1a0-0fcc-48c6-a140-783cbc3e26a9 req-1aa1808a-cfe2-44f6-ba70-5874bc8ba44d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb8d3af9-4513-4f65-8863-0f910fd46f04", "name": "network-vif-plugged", "status": "completed", "tag": "eb607d9e-2e93-47a0-8ad5-4d68c6faaa44"}]} {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:46:50.904694 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 10:46:50.904694 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: warnings.warn(msg) Dec 24 10:46:50.913711 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [req-a832d1a0-0fcc-48c6-a140-783cbc3e26a9 req-1aa1808a-cfe2-44f6-ba70-5874bc8ba44d service nova] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:50.915547 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [req-a832d1a0-0fcc-48c6-a140-783cbc3e26a9 req-1aa1808a-cfe2-44f6-ba70-5874bc8ba44d service nova] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:50.933559 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.compute.server_external_events [req-a832d1a0-0fcc-48c6-a140-783cbc3e26a9 req-1aa1808a-cfe2-44f6-ba70-5874bc8ba44d service nova] Creating event network-vif-plugged:eb607d9e-2e93-47a0-8ad5-4d68c6faaa44 for instance fb8d3af9-4513-4f65-8863-0f910fd46f04 on hv-cinder-81644 Dec 24 10:46:50.938886 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [req-a832d1a0-0fcc-48c6-a140-783cbc3e26a9 req-1aa1808a-cfe2-44f6-ba70-5874bc8ba44d service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055455 Dec 24 10:46:50.940187 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 166/325] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Dec 24 10:46:50 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 10:46:50.976500 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-c481249d-7850-4293-b492-798a46a247c8 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d627b760f74f48ac560e2ce2e74e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '378bb44ad89440e49f7e290a5d31004e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:46:50.983843 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-c481249d-7850-4293-b492-798a46a247c8 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] 10.222.0.30 "GET /compute/v2.1/servers/54d2f913-8385-4f34-8cb0-8c0f08c7a30f" status: 200 len: 1522 microversion: 2.1 time: 0.245978 Dec 24 10:46:50.985127 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 160/326] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:46:50 2021] GET /compute/v2.1/servers/54d2f913-8385-4f34-8cb0-8c0f08c7a30f => generated 1522 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 24 10:46:51.038038 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-38782191-f6ad-44fb-b789-3d18075265b3 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:46:51.039490 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-38782191-f6ad-44fb-b789-3d18075265b3 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] [instance: a99a6a98-4010-4f8e-a83f-fcc490f6ece0] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:46:51.046978 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-38782191-f6ad-44fb-b789-3d18075265b3 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:51.047634 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-38782191-f6ad-44fb-b789-3d18075265b3 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:51.048588 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-38782191-f6ad-44fb-b789-3d18075265b3 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:51.049340 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-38782191-f6ad-44fb-b789-3d18075265b3 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:51.171318 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-38782191-f6ad-44fb-b789-3d18075265b3 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] 10.222.0.30 "POST /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0/action" status: 200 len: 33894 microversion: 2.20 time: 0.147488 Dec 24 10:46:51.173282 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 167/327] 10.222.0.30 () {62 vars in 1318 bytes} [Fri Dec 24 10:46:51 2021] POST /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0/action => generated 33894 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 24 10:46:51.643683 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-76160230-158c-47b1-a20d-22927098126e tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:46:51.645724 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-76160230-158c-47b1-a20d-22927098126e tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] [instance: fb8d3af9-4513-4f65-8863-0f910fd46f04] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:46:51.657265 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-76160230-158c-47b1-a20d-22927098126e tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:51.657717 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-76160230-158c-47b1-a20d-22927098126e tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:51.658513 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-76160230-158c-47b1-a20d-22927098126e tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:51.658953 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-76160230-158c-47b1-a20d-22927098126e tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:51.776766 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-5256bd46-ee29-4ed9-befc-3dc8b354d4ba tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:46:51.778875 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-5256bd46-ee29-4ed9-befc-3dc8b354d4ba tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] [instance: 9330dbb8-edad-4d54-afeb-8badc464250d] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:46:51.791352 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-5256bd46-ee29-4ed9-befc-3dc8b354d4ba tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:51.792045 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-5256bd46-ee29-4ed9-befc-3dc8b354d4ba tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:51.793088 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-5256bd46-ee29-4ed9-befc-3dc8b354d4ba tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:51.794026 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-5256bd46-ee29-4ed9-befc-3dc8b354d4ba tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:51.874662 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-76160230-158c-47b1-a20d-22927098126e tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ad5096717dc425c849dfe95ea55a6af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62d11172cdf4959a15ac1ffc5601aca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:46:51.882797 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-76160230-158c-47b1-a20d-22927098126e tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] 10.222.0.30 "GET /compute/v2.1/servers/fb8d3af9-4513-4f65-8863-0f910fd46f04" status: 200 len: 1318 microversion: 2.1 time: 0.243187 Dec 24 10:46:51.883361 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 161/328] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:46:51 2021] GET /compute/v2.1/servers/fb8d3af9-4513-4f65-8863-0f910fd46f04 => generated 1318 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:46:51.895539 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-5256bd46-ee29-4ed9-befc-3dc8b354d4ba tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] 10.222.0.30 "POST /compute/v2.1/servers/9330dbb8-edad-4d54-afeb-8badc464250d/action" status: 200 len: 14 microversion: 2.1 time: 0.124169 Dec 24 10:46:51.898917 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 168/329] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Dec 24 10:46:51 2021] POST /compute/v2.1/servers/9330dbb8-edad-4d54-afeb-8badc464250d/action => generated 14 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 24 10:46:52.000947 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-5f1c81fc-a136-4f84-8967-c49bc23f0ce2 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:46:52.001558 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-5f1c81fc-a136-4f84-8967-c49bc23f0ce2 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] [instance: 54d2f913-8385-4f34-8cb0-8c0f08c7a30f] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:46:52.008232 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-5f1c81fc-a136-4f84-8967-c49bc23f0ce2 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:52.008740 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-5f1c81fc-a136-4f84-8967-c49bc23f0ce2 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:52.009743 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-5f1c81fc-a136-4f84-8967-c49bc23f0ce2 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:52.010334 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-5f1c81fc-a136-4f84-8967-c49bc23f0ce2 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:52.168943 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-5f1c81fc-a136-4f84-8967-c49bc23f0ce2 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d627b760f74f48ac560e2ce2e74e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '378bb44ad89440e49f7e290a5d31004e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:46:52.178866 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-5f1c81fc-a136-4f84-8967-c49bc23f0ce2 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] 10.222.0.30 "GET /compute/v2.1/servers/54d2f913-8385-4f34-8cb0-8c0f08c7a30f" status: 200 len: 1522 microversion: 2.1 time: 0.181443 Dec 24 10:46:52.180867 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 162/330] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:46:51 2021] GET /compute/v2.1/servers/54d2f913-8385-4f34-8cb0-8c0f08c7a30f => generated 1522 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:46:52.189972 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-0378d8fe-8640-448f-b238-bc4aa0d4a465 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:46:52.191543 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-0378d8fe-8640-448f-b238-bc4aa0d4a465 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] [instance: a99a6a98-4010-4f8e-a83f-fcc490f6ece0] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:46:52.198928 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-0378d8fe-8640-448f-b238-bc4aa0d4a465 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:52.199568 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-0378d8fe-8640-448f-b238-bc4aa0d4a465 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:52.200424 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-0378d8fe-8640-448f-b238-bc4aa0d4a465 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:52.200775 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-0378d8fe-8640-448f-b238-bc4aa0d4a465 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:52.292149 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-0378d8fe-8640-448f-b238-bc4aa0d4a465 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] 10.222.0.30 "POST /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0/action" status: 200 len: 34349 microversion: 2.20 time: 0.106828 Dec 24 10:46:52.296921 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 169/331] 10.222.0.30 () {62 vars in 1318 bytes} [Fri Dec 24 10:46:52 2021] POST /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0/action => generated 34349 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 24 10:46:52.902646 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-83f8433d-8d7f-4d08-938e-eaceff245992 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:46:52.902646 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-83f8433d-8d7f-4d08-938e-eaceff245992 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] [instance: fb8d3af9-4513-4f65-8863-0f910fd46f04] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:46:52.906338 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-179ed2e2-5bf2-4783-872a-aa78fa11d781 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:46:52.907334 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-179ed2e2-5bf2-4783-872a-aa78fa11d781 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] [instance: 9330dbb8-edad-4d54-afeb-8badc464250d] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:46:52.908315 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-83f8433d-8d7f-4d08-938e-eaceff245992 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:52.908762 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-83f8433d-8d7f-4d08-938e-eaceff245992 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:52.910300 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-83f8433d-8d7f-4d08-938e-eaceff245992 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:52.910897 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-83f8433d-8d7f-4d08-938e-eaceff245992 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:52.920118 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-179ed2e2-5bf2-4783-872a-aa78fa11d781 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:52.920560 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-179ed2e2-5bf2-4783-872a-aa78fa11d781 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:52.926450 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-179ed2e2-5bf2-4783-872a-aa78fa11d781 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:52.926944 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-179ed2e2-5bf2-4783-872a-aa78fa11d781 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:53.017044 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-179ed2e2-5bf2-4783-872a-aa78fa11d781 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] 10.222.0.30 "POST /compute/v2.1/servers/9330dbb8-edad-4d54-afeb-8badc464250d/action" status: 200 len: 14 microversion: 2.1 time: 0.114415 Dec 24 10:46:53.017815 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 170/332] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Dec 24 10:46:52 2021] POST /compute/v2.1/servers/9330dbb8-edad-4d54-afeb-8badc464250d/action => generated 14 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Dec 24 10:46:53.078881 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-83f8433d-8d7f-4d08-938e-eaceff245992 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ad5096717dc425c849dfe95ea55a6af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62d11172cdf4959a15ac1ffc5601aca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:46:53.089145 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-83f8433d-8d7f-4d08-938e-eaceff245992 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] 10.222.0.30 "GET /compute/v2.1/servers/fb8d3af9-4513-4f65-8863-0f910fd46f04" status: 200 len: 1318 microversion: 2.1 time: 0.193349 Dec 24 10:46:53.089934 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 163/333] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:46:52 2021] GET /compute/v2.1/servers/fb8d3af9-4513-4f65-8863-0f910fd46f04 => generated 1318 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:46:53.196412 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-d8977188-df49-4dfd-93c4-c500137abaa0 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:46:53.197293 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-d8977188-df49-4dfd-93c4-c500137abaa0 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] [instance: 54d2f913-8385-4f34-8cb0-8c0f08c7a30f] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:46:53.204246 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-d8977188-df49-4dfd-93c4-c500137abaa0 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:53.204763 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-d8977188-df49-4dfd-93c4-c500137abaa0 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:53.205637 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-d8977188-df49-4dfd-93c4-c500137abaa0 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:53.206144 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-d8977188-df49-4dfd-93c4-c500137abaa0 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:53.304192 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-dc6ef4e5-48eb-4423-8bc3-24c6a9ea4257 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:46:53.305150 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-dc6ef4e5-48eb-4423-8bc3-24c6a9ea4257 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] [instance: a99a6a98-4010-4f8e-a83f-fcc490f6ece0] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:46:53.312189 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-dc6ef4e5-48eb-4423-8bc3-24c6a9ea4257 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:53.312674 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-dc6ef4e5-48eb-4423-8bc3-24c6a9ea4257 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:53.316761 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-dc6ef4e5-48eb-4423-8bc3-24c6a9ea4257 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:53.316761 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-dc6ef4e5-48eb-4423-8bc3-24c6a9ea4257 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:53.360508 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-d8977188-df49-4dfd-93c4-c500137abaa0 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d627b760f74f48ac560e2ce2e74e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '378bb44ad89440e49f7e290a5d31004e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:46:53.370939 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-d8977188-df49-4dfd-93c4-c500137abaa0 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] 10.222.0.30 "GET /compute/v2.1/servers/54d2f913-8385-4f34-8cb0-8c0f08c7a30f" status: 200 len: 1522 microversion: 2.1 time: 0.178481 Dec 24 10:46:53.371528 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 171/334] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:46:53 2021] GET /compute/v2.1/servers/54d2f913-8385-4f34-8cb0-8c0f08c7a30f => generated 1522 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:46:53.485751 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-dc6ef4e5-48eb-4423-8bc3-24c6a9ea4257 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] 10.222.0.30 "POST /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0/action" status: 200 len: 34814 microversion: 2.20 time: 0.184912 Dec 24 10:46:53.487466 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 164/335] 10.222.0.30 () {62 vars in 1318 bytes} [Fri Dec 24 10:46:53 2021] POST /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0/action => generated 34814 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 24 10:46:54.033182 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-74014dfd-990e-4102-9d9b-de111239189e tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:46:54.034242 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-74014dfd-990e-4102-9d9b-de111239189e tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] [instance: 9330dbb8-edad-4d54-afeb-8badc464250d] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:46:54.041460 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-74014dfd-990e-4102-9d9b-de111239189e tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:54.042010 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-74014dfd-990e-4102-9d9b-de111239189e tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:54.043781 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-74014dfd-990e-4102-9d9b-de111239189e tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:54.044304 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-74014dfd-990e-4102-9d9b-de111239189e tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:54.108524 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-d5e249de-931b-4e90-a8ce-161f29eb9e98 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:46:54.109334 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-d5e249de-931b-4e90-a8ce-161f29eb9e98 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] [instance: fb8d3af9-4513-4f65-8863-0f910fd46f04] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:46:54.119815 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-d5e249de-931b-4e90-a8ce-161f29eb9e98 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:54.120182 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-d5e249de-931b-4e90-a8ce-161f29eb9e98 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:54.121017 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-d5e249de-931b-4e90-a8ce-161f29eb9e98 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:54.121624 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-d5e249de-931b-4e90-a8ce-161f29eb9e98 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:54.137128 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-74014dfd-990e-4102-9d9b-de111239189e tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] 10.222.0.30 "POST /compute/v2.1/servers/9330dbb8-edad-4d54-afeb-8badc464250d/action" status: 200 len: 14 microversion: 2.1 time: 0.107953 Dec 24 10:46:54.141204 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 172/336] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Dec 24 10:46:54 2021] POST /compute/v2.1/servers/9330dbb8-edad-4d54-afeb-8badc464250d/action => generated 14 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 24 10:46:54.298715 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-d5e249de-931b-4e90-a8ce-161f29eb9e98 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ad5096717dc425c849dfe95ea55a6af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62d11172cdf4959a15ac1ffc5601aca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:46:54.320048 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-d5e249de-931b-4e90-a8ce-161f29eb9e98 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] 10.222.0.30 "GET /compute/v2.1/servers/fb8d3af9-4513-4f65-8863-0f910fd46f04" status: 200 len: 1507 microversion: 2.1 time: 0.216564 Dec 24 10:46:54.321079 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 165/337] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:46:54 2021] GET /compute/v2.1/servers/fb8d3af9-4513-4f65-8863-0f910fd46f04 => generated 1507 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 24 10:46:54.392920 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-6daf009b-2677-4816-a655-4fd5c11aed3c tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:46:54.392920 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-6daf009b-2677-4816-a655-4fd5c11aed3c tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] [instance: 54d2f913-8385-4f34-8cb0-8c0f08c7a30f] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:46:54.402887 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-6daf009b-2677-4816-a655-4fd5c11aed3c tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:54.403572 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-6daf009b-2677-4816-a655-4fd5c11aed3c tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:54.404530 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-6daf009b-2677-4816-a655-4fd5c11aed3c tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:54.404990 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-6daf009b-2677-4816-a655-4fd5c11aed3c tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:54.498908 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-1d093ec7-c724-4677-9b74-d2ee5a76fc96 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:46:54.499815 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-1d093ec7-c724-4677-9b74-d2ee5a76fc96 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] [instance: a99a6a98-4010-4f8e-a83f-fcc490f6ece0] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:46:54.506454 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-1d093ec7-c724-4677-9b74-d2ee5a76fc96 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:54.506904 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-1d093ec7-c724-4677-9b74-d2ee5a76fc96 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:54.507689 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-1d093ec7-c724-4677-9b74-d2ee5a76fc96 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:54.508325 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-1d093ec7-c724-4677-9b74-d2ee5a76fc96 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:54.615671 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-6daf009b-2677-4816-a655-4fd5c11aed3c tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d627b760f74f48ac560e2ce2e74e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '378bb44ad89440e49f7e290a5d31004e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:46:54.623571 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-6daf009b-2677-4816-a655-4fd5c11aed3c tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] 10.222.0.30 "GET /compute/v2.1/servers/54d2f913-8385-4f34-8cb0-8c0f08c7a30f" status: 200 len: 1522 microversion: 2.1 time: 0.238891 Dec 24 10:46:54.624273 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 173/338] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:46:54 2021] GET /compute/v2.1/servers/54d2f913-8385-4f34-8cb0-8c0f08c7a30f => generated 1522 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:46:54.643272 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-1d093ec7-c724-4677-9b74-d2ee5a76fc96 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] 10.222.0.30 "POST /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0/action" status: 200 len: 35307 microversion: 2.20 time: 0.147916 Dec 24 10:46:54.647454 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 166/339] 10.222.0.30 () {62 vars in 1318 bytes} [Fri Dec 24 10:46:54 2021] POST /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0/action => generated 35307 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 24 10:46:55.151651 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-ecce4d38-8791-4348-ac66-9e7187844630 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:46:55.152666 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-ecce4d38-8791-4348-ac66-9e7187844630 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] [instance: 9330dbb8-edad-4d54-afeb-8badc464250d] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:46:55.159640 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-ecce4d38-8791-4348-ac66-9e7187844630 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:55.160093 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-ecce4d38-8791-4348-ac66-9e7187844630 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:55.160907 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-ecce4d38-8791-4348-ac66-9e7187844630 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:55.161344 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-ecce4d38-8791-4348-ac66-9e7187844630 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:55.255288 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-ecce4d38-8791-4348-ac66-9e7187844630 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] 10.222.0.30 "POST /compute/v2.1/servers/9330dbb8-edad-4d54-afeb-8badc464250d/action" status: 200 len: 14 microversion: 2.1 time: 0.104573 Dec 24 10:46:55.262697 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 174/340] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Dec 24 10:46:55 2021] POST /compute/v2.1/servers/9330dbb8-edad-4d54-afeb-8badc464250d/action => generated 14 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 24 10:46:55.641703 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-ab8488b7-5a6f-4951-a1b9-d95a19ad4033 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:46:55.642401 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-ab8488b7-5a6f-4951-a1b9-d95a19ad4033 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] [instance: 54d2f913-8385-4f34-8cb0-8c0f08c7a30f] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:46:55.652213 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-ab8488b7-5a6f-4951-a1b9-d95a19ad4033 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:55.660692 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-1a35ed7d-ab12-4522-aa33-5f6e16eb4a08 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:46:55.661732 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-1a35ed7d-ab12-4522-aa33-5f6e16eb4a08 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] [instance: a99a6a98-4010-4f8e-a83f-fcc490f6ece0] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:46:55.664930 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-ab8488b7-5a6f-4951-a1b9-d95a19ad4033 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:55.668496 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-ab8488b7-5a6f-4951-a1b9-d95a19ad4033 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:55.669293 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-ab8488b7-5a6f-4951-a1b9-d95a19ad4033 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:55.679999 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-1a35ed7d-ab12-4522-aa33-5f6e16eb4a08 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:55.680451 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-1a35ed7d-ab12-4522-aa33-5f6e16eb4a08 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:55.681282 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-1a35ed7d-ab12-4522-aa33-5f6e16eb4a08 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:55.681710 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-1a35ed7d-ab12-4522-aa33-5f6e16eb4a08 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:55.802641 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-1a35ed7d-ab12-4522-aa33-5f6e16eb4a08 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] 10.222.0.30 "POST /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0/action" status: 200 len: 35969 microversion: 2.20 time: 0.143569 Dec 24 10:46:55.802641 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 175/341] 10.222.0.30 () {62 vars in 1318 bytes} [Fri Dec 24 10:46:55 2021] POST /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0/action => generated 35969 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 24 10:46:55.892201 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-ab8488b7-5a6f-4951-a1b9-d95a19ad4033 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d627b760f74f48ac560e2ce2e74e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '378bb44ad89440e49f7e290a5d31004e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:46:55.904411 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-ab8488b7-5a6f-4951-a1b9-d95a19ad4033 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] 10.222.0.30 "GET /compute/v2.1/servers/54d2f913-8385-4f34-8cb0-8c0f08c7a30f" status: 200 len: 1522 microversion: 2.1 time: 0.265079 Dec 24 10:46:55.905492 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 167/342] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:46:55 2021] GET /compute/v2.1/servers/54d2f913-8385-4f34-8cb0-8c0f08c7a30f => generated 1522 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:46:56.060606 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-0aca4437-bcbf-44a3-b33e-1ccf666d9d0f tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "300d1d50-e2cc-4856-bd5f-946fb0d1394b"}} {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:46:56.061991 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-0aca4437-bcbf-44a3-b33e-1ccf666d9d0f tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] [instance: fb8d3af9-4513-4f65-8863-0f910fd46f04] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:46:56.070448 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-0aca4437-bcbf-44a3-b33e-1ccf666d9d0f tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:56.070968 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-0aca4437-bcbf-44a3-b33e-1ccf666d9d0f tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:56.071911 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-0aca4437-bcbf-44a3-b33e-1ccf666d9d0f tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:56.072516 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-0aca4437-bcbf-44a3-b33e-1ccf666d9d0f tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:56.270158 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-0563796e-3882-44a0-81e6-7db65fb2f821 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:46:56.271540 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-0563796e-3882-44a0-81e6-7db65fb2f821 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] [instance: 9330dbb8-edad-4d54-afeb-8badc464250d] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:46:56.279059 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-0563796e-3882-44a0-81e6-7db65fb2f821 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:56.279831 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-0563796e-3882-44a0-81e6-7db65fb2f821 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:56.281028 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-0563796e-3882-44a0-81e6-7db65fb2f821 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:56.281791 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-0563796e-3882-44a0-81e6-7db65fb2f821 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:56.396198 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-0563796e-3882-44a0-81e6-7db65fb2f821 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] 10.222.0.30 "POST /compute/v2.1/servers/9330dbb8-edad-4d54-afeb-8badc464250d/action" status: 200 len: 14 microversion: 2.1 time: 0.129791 Dec 24 10:46:56.397608 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 168/343] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Dec 24 10:46:56 2021] POST /compute/v2.1/servers/9330dbb8-edad-4d54-afeb-8badc464250d/action => generated 14 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 24 10:46:56.811995 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-acea0012-be08-4b42-839f-7a21a6d95faa tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:46:56.813715 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-acea0012-be08-4b42-839f-7a21a6d95faa tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] [instance: a99a6a98-4010-4f8e-a83f-fcc490f6ece0] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:46:56.821263 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-acea0012-be08-4b42-839f-7a21a6d95faa tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:56.821763 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-acea0012-be08-4b42-839f-7a21a6d95faa tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:56.822499 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-acea0012-be08-4b42-839f-7a21a6d95faa tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:56.823095 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-acea0012-be08-4b42-839f-7a21a6d95faa tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:56.928626 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-acea0012-be08-4b42-839f-7a21a6d95faa tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] 10.222.0.30 "POST /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0/action" status: 200 len: 36711 microversion: 2.20 time: 0.116612 Dec 24 10:46:56.933358 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 169/344] 10.222.0.30 () {62 vars in 1318 bytes} [Fri Dec 24 10:46:56 2021] POST /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0/action => generated 36711 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 24 10:46:56.947953 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-44646017-ff70-44b5-b8ea-37259043897e tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:46:56.949942 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-44646017-ff70-44b5-b8ea-37259043897e tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] [instance: 54d2f913-8385-4f34-8cb0-8c0f08c7a30f] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:46:56.975291 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-44646017-ff70-44b5-b8ea-37259043897e tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:56.975955 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-44646017-ff70-44b5-b8ea-37259043897e tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:56.978170 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-44646017-ff70-44b5-b8ea-37259043897e tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:56.979799 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-44646017-ff70-44b5-b8ea-37259043897e tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:57.107588 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-0aca4437-bcbf-44a3-b33e-1ccf666d9d0f tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] 10.222.0.30 "POST /compute/v2.1/servers/fb8d3af9-4513-4f65-8863-0f910fd46f04/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.051675 Dec 24 10:46:57.108213 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 176/345] 10.222.0.30 () {60 vars in 1322 bytes} [Fri Dec 24 10:46:56 2021] POST /compute/v2.1/servers/fb8d3af9-4513-4f65-8863-0f910fd46f04/os-volume_attachments => generated 194 bytes in 1054 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 10:46:57.409224 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-f4f6fb9b-23b7-4d74-9c24-011b76ffcd7b tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:46:57.410711 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-f4f6fb9b-23b7-4d74-9c24-011b76ffcd7b tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] [instance: 9330dbb8-edad-4d54-afeb-8badc464250d] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:46:57.427237 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-f4f6fb9b-23b7-4d74-9c24-011b76ffcd7b tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:57.430797 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-f4f6fb9b-23b7-4d74-9c24-011b76ffcd7b tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:57.433299 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-f4f6fb9b-23b7-4d74-9c24-011b76ffcd7b tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:57.433946 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-f4f6fb9b-23b7-4d74-9c24-011b76ffcd7b tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:57.538779 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-f4f6fb9b-23b7-4d74-9c24-011b76ffcd7b tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] 10.222.0.30 "POST /compute/v2.1/servers/9330dbb8-edad-4d54-afeb-8badc464250d/action" status: 200 len: 14 microversion: 2.1 time: 0.133743 Dec 24 10:46:57.539769 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 177/346] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Dec 24 10:46:57 2021] POST /compute/v2.1/servers/9330dbb8-edad-4d54-afeb-8badc464250d/action => generated 14 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Dec 24 10:46:57.551471 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-44646017-ff70-44b5-b8ea-37259043897e tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d627b760f74f48ac560e2ce2e74e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '378bb44ad89440e49f7e290a5d31004e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:46:57.559719 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-44646017-ff70-44b5-b8ea-37259043897e tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] 10.222.0.30 "GET /compute/v2.1/servers/54d2f913-8385-4f34-8cb0-8c0f08c7a30f" status: 200 len: 1522 microversion: 2.1 time: 0.624090 Dec 24 10:46:57.560806 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 170/347] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:46:56 2021] GET /compute/v2.1/servers/54d2f913-8385-4f34-8cb0-8c0f08c7a30f => generated 1522 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:46:57.999120 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-28b08d49-9687-4704-bcc6-a6ac046ca87b tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:46:58.000498 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-28b08d49-9687-4704-bcc6-a6ac046ca87b tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] [instance: a99a6a98-4010-4f8e-a83f-fcc490f6ece0] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:46:58.018376 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-28b08d49-9687-4704-bcc6-a6ac046ca87b tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:58.019662 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-28b08d49-9687-4704-bcc6-a6ac046ca87b tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:58.028513 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-28b08d49-9687-4704-bcc6-a6ac046ca87b tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:58.031607 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-28b08d49-9687-4704-bcc6-a6ac046ca87b tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:58.156471 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-28b08d49-9687-4704-bcc6-a6ac046ca87b tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] 10.222.0.30 "POST /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0/action" status: 200 len: 37590 microversion: 2.20 time: 0.162013 Dec 24 10:46:58.158448 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 178/348] 10.222.0.30 () {62 vars in 1318 bytes} [Fri Dec 24 10:46:57 2021] POST /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0/action => generated 37590 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 24 10:46:58.549932 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-27c686ec-26df-4356-8d0e-a89f9ee90043 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:46:58.551878 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-27c686ec-26df-4356-8d0e-a89f9ee90043 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] [instance: 9330dbb8-edad-4d54-afeb-8badc464250d] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:46:58.560083 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-27c686ec-26df-4356-8d0e-a89f9ee90043 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:58.561644 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-27c686ec-26df-4356-8d0e-a89f9ee90043 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:58.564176 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-27c686ec-26df-4356-8d0e-a89f9ee90043 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:58.565999 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-27c686ec-26df-4356-8d0e-a89f9ee90043 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:58.578694 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-0480759f-9625-4bfe-b09a-b2e0401bc2e2 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:46:58.579629 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-0480759f-9625-4bfe-b09a-b2e0401bc2e2 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] [instance: 54d2f913-8385-4f34-8cb0-8c0f08c7a30f] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:46:58.590834 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-0480759f-9625-4bfe-b09a-b2e0401bc2e2 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:58.595129 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-0480759f-9625-4bfe-b09a-b2e0401bc2e2 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:58.598757 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-0480759f-9625-4bfe-b09a-b2e0401bc2e2 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:58.599238 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-0480759f-9625-4bfe-b09a-b2e0401bc2e2 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:58.655516 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-27c686ec-26df-4356-8d0e-a89f9ee90043 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] 10.222.0.30 "POST /compute/v2.1/servers/9330dbb8-edad-4d54-afeb-8badc464250d/action" status: 200 len: 14 microversion: 2.1 time: 0.109292 Dec 24 10:46:58.656401 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 171/349] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Dec 24 10:46:58 2021] POST /compute/v2.1/servers/9330dbb8-edad-4d54-afeb-8badc464250d/action => generated 14 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 24 10:46:58.863534 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-0480759f-9625-4bfe-b09a-b2e0401bc2e2 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d627b760f74f48ac560e2ce2e74e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '378bb44ad89440e49f7e290a5d31004e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:46:58.874365 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-0480759f-9625-4bfe-b09a-b2e0401bc2e2 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] 10.222.0.30 "GET /compute/v2.1/servers/54d2f913-8385-4f34-8cb0-8c0f08c7a30f" status: 200 len: 1522 microversion: 2.1 time: 0.301079 Dec 24 10:46:58.875542 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 179/350] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:46:58 2021] GET /compute/v2.1/servers/54d2f913-8385-4f34-8cb0-8c0f08c7a30f => generated 1522 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:46:59.170009 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-b89e7ce2-251d-4f60-b660-171b8a781f59 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:46:59.171001 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-b89e7ce2-251d-4f60-b660-171b8a781f59 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] [instance: a99a6a98-4010-4f8e-a83f-fcc490f6ece0] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:46:59.179470 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-b89e7ce2-251d-4f60-b660-171b8a781f59 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:59.179984 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-b89e7ce2-251d-4f60-b660-171b8a781f59 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:59.180780 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-b89e7ce2-251d-4f60-b660-171b8a781f59 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:59.181236 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-b89e7ce2-251d-4f60-b660-171b8a781f59 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:59.674804 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-602c038c-5555-45a0-8256-d7a6343460c0 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:46:59.676412 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-602c038c-5555-45a0-8256-d7a6343460c0 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] [instance: 9330dbb8-edad-4d54-afeb-8badc464250d] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:46:59.685551 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-602c038c-5555-45a0-8256-d7a6343460c0 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:59.685999 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-602c038c-5555-45a0-8256-d7a6343460c0 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:46:59.686837 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-602c038c-5555-45a0-8256-d7a6343460c0 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:46:59.687269 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-602c038c-5555-45a0-8256-d7a6343460c0 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:01.869180 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-b89e7ce2-251d-4f60-b660-171b8a781f59 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] 10.222.0.30 "POST /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0/action" status: 200 len: 38101 microversion: 2.20 time: 2.703246 Dec 24 10:47:01.870498 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 172/351] 10.222.0.30 () {62 vars in 1318 bytes} [Fri Dec 24 10:46:59 2021] POST /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0/action => generated 38101 bytes in 2706 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 24 10:47:01.878976 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-a30d77cf-3b8d-4644-b362-b8a3792be90f tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:47:01.880035 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-a30d77cf-3b8d-4644-b362-b8a3792be90f tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] [instance: 54d2f913-8385-4f34-8cb0-8c0f08c7a30f] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:47:01.888088 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-602c038c-5555-45a0-8256-d7a6343460c0 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] 10.222.0.30 "POST /compute/v2.1/servers/9330dbb8-edad-4d54-afeb-8badc464250d/action" status: 200 len: 14 microversion: 2.1 time: 2.224961 Dec 24 10:47:01.892729 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 180/352] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Dec 24 10:46:59 2021] POST /compute/v2.1/servers/9330dbb8-edad-4d54-afeb-8badc464250d/action => generated 14 bytes in 2230 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 24 10:47:01.899862 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-a30d77cf-3b8d-4644-b362-b8a3792be90f tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:01.902179 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-a30d77cf-3b8d-4644-b362-b8a3792be90f tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:01.912694 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-a30d77cf-3b8d-4644-b362-b8a3792be90f tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:01.912694 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-a30d77cf-3b8d-4644-b362-b8a3792be90f tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:02.178478 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-a30d77cf-3b8d-4644-b362-b8a3792be90f tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d627b760f74f48ac560e2ce2e74e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '378bb44ad89440e49f7e290a5d31004e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:47:02.188785 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-a30d77cf-3b8d-4644-b362-b8a3792be90f tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] 10.222.0.30 "GET /compute/v2.1/servers/54d2f913-8385-4f34-8cb0-8c0f08c7a30f" status: 200 len: 1522 microversion: 2.1 time: 0.316548 Dec 24 10:47:02.189970 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 173/353] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:47:01 2021] GET /compute/v2.1/servers/54d2f913-8385-4f34-8cb0-8c0f08c7a30f => generated 1522 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:47:02.883020 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-c06396e8-3340-4c39-814b-df2eabe40ba5 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:47:02.884290 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-c06396e8-3340-4c39-814b-df2eabe40ba5 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] [instance: a99a6a98-4010-4f8e-a83f-fcc490f6ece0] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:47:02.899731 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-cd3dca98-254b-4710-b9cb-a12878efed8b tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:47:02.900796 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-cd3dca98-254b-4710-b9cb-a12878efed8b tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] [instance: 9330dbb8-edad-4d54-afeb-8badc464250d] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:47:02.909730 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-cd3dca98-254b-4710-b9cb-a12878efed8b tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:02.914709 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-c06396e8-3340-4c39-814b-df2eabe40ba5 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:02.915251 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-c06396e8-3340-4c39-814b-df2eabe40ba5 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:02.916135 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-c06396e8-3340-4c39-814b-df2eabe40ba5 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:02.916764 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-c06396e8-3340-4c39-814b-df2eabe40ba5 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:02.919138 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-cd3dca98-254b-4710-b9cb-a12878efed8b tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:02.920243 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-cd3dca98-254b-4710-b9cb-a12878efed8b tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:02.922723 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-cd3dca98-254b-4710-b9cb-a12878efed8b tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:03.034147 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-cd3dca98-254b-4710-b9cb-a12878efed8b tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] 10.222.0.30 "POST /compute/v2.1/servers/9330dbb8-edad-4d54-afeb-8badc464250d/action" status: 200 len: 14 microversion: 2.1 time: 0.136913 Dec 24 10:47:03.034829 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 174/354] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Dec 24 10:47:02 2021] POST /compute/v2.1/servers/9330dbb8-edad-4d54-afeb-8badc464250d/action => generated 14 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 24 10:47:03.059171 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-c06396e8-3340-4c39-814b-df2eabe40ba5 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] 10.222.0.30 "POST /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0/action" status: 200 len: 38108 microversion: 2.20 time: 0.180277 Dec 24 10:47:03.060512 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 181/355] 10.222.0.30 () {62 vars in 1318 bytes} [Fri Dec 24 10:47:02 2021] POST /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0/action => generated 38108 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 24 10:47:03.206377 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-41320279-4ec3-495b-ba17-a08ba6cad7a9 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:47:03.207038 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-41320279-4ec3-495b-ba17-a08ba6cad7a9 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] [instance: 54d2f913-8385-4f34-8cb0-8c0f08c7a30f] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:47:03.215429 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-41320279-4ec3-495b-ba17-a08ba6cad7a9 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:03.219574 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-41320279-4ec3-495b-ba17-a08ba6cad7a9 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:03.219574 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-41320279-4ec3-495b-ba17-a08ba6cad7a9 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:03.219574 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-41320279-4ec3-495b-ba17-a08ba6cad7a9 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:03.466240 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-41320279-4ec3-495b-ba17-a08ba6cad7a9 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d627b760f74f48ac560e2ce2e74e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '378bb44ad89440e49f7e290a5d31004e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:47:03.475890 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-41320279-4ec3-495b-ba17-a08ba6cad7a9 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] 10.222.0.30 "GET /compute/v2.1/servers/54d2f913-8385-4f34-8cb0-8c0f08c7a30f" status: 200 len: 1522 microversion: 2.1 time: 0.272460 Dec 24 10:47:03.485016 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 175/356] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:47:03 2021] GET /compute/v2.1/servers/54d2f913-8385-4f34-8cb0-8c0f08c7a30f => generated 1522 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:47:04.047193 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-d7086e70-ebbc-4a29-99f4-f4792c106c00 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:47:04.048340 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-d7086e70-ebbc-4a29-99f4-f4792c106c00 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] [instance: 9330dbb8-edad-4d54-afeb-8badc464250d] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:47:04.062527 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-d7086e70-ebbc-4a29-99f4-f4792c106c00 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:04.071733 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-53e231a7-91d3-4535-95dc-447e6e2e64c8 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:47:04.072805 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-53e231a7-91d3-4535-95dc-447e6e2e64c8 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] [instance: a99a6a98-4010-4f8e-a83f-fcc490f6ece0] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:47:04.079737 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-d7086e70-ebbc-4a29-99f4-f4792c106c00 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:04.081947 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-d7086e70-ebbc-4a29-99f4-f4792c106c00 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:04.104497 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-53e231a7-91d3-4535-95dc-447e6e2e64c8 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:04.106553 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-d7086e70-ebbc-4a29-99f4-f4792c106c00 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:04.111394 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-53e231a7-91d3-4535-95dc-447e6e2e64c8 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:04.118621 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-53e231a7-91d3-4535-95dc-447e6e2e64c8 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:04.122592 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-53e231a7-91d3-4535-95dc-447e6e2e64c8 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:04.266531 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-d7086e70-ebbc-4a29-99f4-f4792c106c00 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] 10.222.0.30 "POST /compute/v2.1/servers/9330dbb8-edad-4d54-afeb-8badc464250d/action" status: 200 len: 14 microversion: 2.1 time: 0.224251 Dec 24 10:47:04.272035 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 182/357] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Dec 24 10:47:04 2021] POST /compute/v2.1/servers/9330dbb8-edad-4d54-afeb-8badc464250d/action => generated 14 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 24 10:47:04.287375 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-53e231a7-91d3-4535-95dc-447e6e2e64c8 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] 10.222.0.30 "POST /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0/action" status: 200 len: 38243 microversion: 2.20 time: 0.219238 Dec 24 10:47:04.288468 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 176/358] 10.222.0.30 () {62 vars in 1318 bytes} [Fri Dec 24 10:47:04 2021] POST /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0/action => generated 38243 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 24 10:47:04.304180 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-f7ecc45c-4ae8-4a93-998a-a6fd49668396 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:47:04.305266 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-f7ecc45c-4ae8-4a93-998a-a6fd49668396 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] [instance: a99a6a98-4010-4f8e-a83f-fcc490f6ece0] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:47:04.321242 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-f7ecc45c-4ae8-4a93-998a-a6fd49668396 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:04.321242 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-f7ecc45c-4ae8-4a93-998a-a6fd49668396 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:04.321242 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-f7ecc45c-4ae8-4a93-998a-a6fd49668396 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:04.321242 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-f7ecc45c-4ae8-4a93-998a-a6fd49668396 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:04.349689 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-f7ecc45c-4ae8-4a93-998a-a6fd49668396 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] 10.222.0.30 "GET /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0/ips" status: 200 len: 151 microversion: 2.20 time: 0.051316 Dec 24 10:47:04.353432 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 183/359] 10.222.0.30 () {60 vars in 1288 bytes} [Fri Dec 24 10:47:04 2021] GET /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0/ips => generated 151 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 24 10:47:04.499847 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-58541bbc-6e03-41d2-b0d2-6bb7787c0224 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:47:04.501164 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-58541bbc-6e03-41d2-b0d2-6bb7787c0224 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] [instance: 54d2f913-8385-4f34-8cb0-8c0f08c7a30f] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:47:04.515960 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-58541bbc-6e03-41d2-b0d2-6bb7787c0224 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:04.517166 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-58541bbc-6e03-41d2-b0d2-6bb7787c0224 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:04.518171 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-58541bbc-6e03-41d2-b0d2-6bb7787c0224 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:04.519304 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-58541bbc-6e03-41d2-b0d2-6bb7787c0224 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:04.749721 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-58541bbc-6e03-41d2-b0d2-6bb7787c0224 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d627b760f74f48ac560e2ce2e74e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '378bb44ad89440e49f7e290a5d31004e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:47:04.769961 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-58541bbc-6e03-41d2-b0d2-6bb7787c0224 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] 10.222.0.30 "GET /compute/v2.1/servers/54d2f913-8385-4f34-8cb0-8c0f08c7a30f" status: 200 len: 1522 microversion: 2.1 time: 0.263676 Dec 24 10:47:04.771487 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 177/360] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:47:04 2021] GET /compute/v2.1/servers/54d2f913-8385-4f34-8cb0-8c0f08c7a30f => generated 1522 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:47:05.279486 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-e5ce5601-f78a-4ced-bf48-d809f8a68b39 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:47:05.281576 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-e5ce5601-f78a-4ced-bf48-d809f8a68b39 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] [instance: 9330dbb8-edad-4d54-afeb-8badc464250d] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:47:05.296422 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-e5ce5601-f78a-4ced-bf48-d809f8a68b39 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:05.297156 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-e5ce5601-f78a-4ced-bf48-d809f8a68b39 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:05.300729 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-e5ce5601-f78a-4ced-bf48-d809f8a68b39 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:05.301220 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-e5ce5601-f78a-4ced-bf48-d809f8a68b39 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:05.378834 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-e5ce5601-f78a-4ced-bf48-d809f8a68b39 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] 10.222.0.30 "POST /compute/v2.1/servers/9330dbb8-edad-4d54-afeb-8badc464250d/action" status: 200 len: 14 microversion: 2.1 time: 0.103893 Dec 24 10:47:05.382821 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 184/361] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Dec 24 10:47:05 2021] POST /compute/v2.1/servers/9330dbb8-edad-4d54-afeb-8badc464250d/action => generated 14 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 24 10:47:05.794802 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-f1a4b8f9-e00f-407e-aedc-9b95080b9491 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:47:05.795499 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-f1a4b8f9-e00f-407e-aedc-9b95080b9491 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] [instance: 54d2f913-8385-4f34-8cb0-8c0f08c7a30f] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:47:05.805772 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-f1a4b8f9-e00f-407e-aedc-9b95080b9491 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:05.806099 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-f1a4b8f9-e00f-407e-aedc-9b95080b9491 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:05.809200 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-f1a4b8f9-e00f-407e-aedc-9b95080b9491 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:05.812717 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-f1a4b8f9-e00f-407e-aedc-9b95080b9491 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:06.062059 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-f1a4b8f9-e00f-407e-aedc-9b95080b9491 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d627b760f74f48ac560e2ce2e74e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '378bb44ad89440e49f7e290a5d31004e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:47:06.073754 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-f1a4b8f9-e00f-407e-aedc-9b95080b9491 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] 10.222.0.30 "GET /compute/v2.1/servers/54d2f913-8385-4f34-8cb0-8c0f08c7a30f" status: 200 len: 1522 microversion: 2.1 time: 0.289894 Dec 24 10:47:06.074619 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 178/362] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:47:05 2021] GET /compute/v2.1/servers/54d2f913-8385-4f34-8cb0-8c0f08c7a30f => generated 1522 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:47:06.392590 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-2adfc6c0-8317-41ec-864a-95dc45db380b tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:47:06.394828 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-2adfc6c0-8317-41ec-864a-95dc45db380b tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] [instance: 9330dbb8-edad-4d54-afeb-8badc464250d] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:47:06.403369 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-2adfc6c0-8317-41ec-864a-95dc45db380b tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:06.404143 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-2adfc6c0-8317-41ec-864a-95dc45db380b tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:06.405532 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-2adfc6c0-8317-41ec-864a-95dc45db380b tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:06.408071 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-2adfc6c0-8317-41ec-864a-95dc45db380b tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:06.490659 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-2adfc6c0-8317-41ec-864a-95dc45db380b tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] 10.222.0.30 "POST /compute/v2.1/servers/9330dbb8-edad-4d54-afeb-8badc464250d/action" status: 200 len: 14 microversion: 2.1 time: 0.102497 Dec 24 10:47:06.491279 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 185/363] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Dec 24 10:47:06 2021] POST /compute/v2.1/servers/9330dbb8-edad-4d54-afeb-8badc464250d/action => generated 14 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 24 10:47:06.964930 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-4dc5e4b7-2f91-433e-9c35-eb61e43a6645 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "300d1d50-e2cc-4856-bd5f-946fb0d1394b"}} {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:47:06.967736 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-4dc5e4b7-2f91-433e-9c35-eb61e43a6645 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] [instance: fb8d3af9-4513-4f65-8863-0f910fd46f04] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:47:06.989100 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-4dc5e4b7-2f91-433e-9c35-eb61e43a6645 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:06.989100 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-4dc5e4b7-2f91-433e-9c35-eb61e43a6645 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:06.990573 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-4dc5e4b7-2f91-433e-9c35-eb61e43a6645 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:06.991149 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-4dc5e4b7-2f91-433e-9c35-eb61e43a6645 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:07.098332 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-ad9850d6-01c3-4a3c-ba11-b326fa7b7baf tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:47:07.099144 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-ad9850d6-01c3-4a3c-ba11-b326fa7b7baf tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] [instance: 54d2f913-8385-4f34-8cb0-8c0f08c7a30f] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:47:07.118411 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-ad9850d6-01c3-4a3c-ba11-b326fa7b7baf tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:07.118945 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-ad9850d6-01c3-4a3c-ba11-b326fa7b7baf tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:07.119869 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-ad9850d6-01c3-4a3c-ba11-b326fa7b7baf tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:07.120483 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-ad9850d6-01c3-4a3c-ba11-b326fa7b7baf tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:07.156326 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.wsgi [None req-4dc5e4b7-2f91-433e-9c35-eb61e43a6645 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] HTTP exception thrown: Invalid volume: volume 300d1d50-e2cc-4856-bd5f-946fb0d1394b is already attached to instances: fb8d3af9-4513-4f65-8863-0f910fd46f04 Dec 24 10:47:07.157185 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-4dc5e4b7-2f91-433e-9c35-eb61e43a6645 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Returning 400 to user: Invalid volume: volume 300d1d50-e2cc-4856-bd5f-946fb0d1394b is already attached to instances: fb8d3af9-4513-4f65-8863-0f910fd46f04 {{(pid=123432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 24 10:47:07.158252 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-4dc5e4b7-2f91-433e-9c35-eb61e43a6645 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] 10.222.0.30 "POST /compute/v2.1/servers/fb8d3af9-4513-4f65-8863-0f910fd46f04/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.208542 Dec 24 10:47:07.160395 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 179/364] 10.222.0.30 () {60 vars in 1322 bytes} [Fri Dec 24 10:47:06 2021] POST /compute/v2.1/servers/fb8d3af9-4513-4f65-8863-0f910fd46f04/os-volume_attachments => generated 174 bytes in 214 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Dec 24 10:47:07.258157 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-e7f61888-6e2e-4211-8c77-0c3168b20388 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:47:07.262930 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-e7f61888-6e2e-4211-8c77-0c3168b20388 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] [instance: fb8d3af9-4513-4f65-8863-0f910fd46f04] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:47:07.275561 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-e7f61888-6e2e-4211-8c77-0c3168b20388 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:07.276031 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-e7f61888-6e2e-4211-8c77-0c3168b20388 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:07.290003 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-e7f61888-6e2e-4211-8c77-0c3168b20388 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:07.290498 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-e7f61888-6e2e-4211-8c77-0c3168b20388 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:07.326182 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-ad9850d6-01c3-4a3c-ba11-b326fa7b7baf tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d627b760f74f48ac560e2ce2e74e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '378bb44ad89440e49f7e290a5d31004e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:47:07.342662 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-ad9850d6-01c3-4a3c-ba11-b326fa7b7baf tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] 10.222.0.30 "GET /compute/v2.1/servers/54d2f913-8385-4f34-8cb0-8c0f08c7a30f" status: 200 len: 1522 microversion: 2.1 time: 0.245050 Dec 24 10:47:07.349711 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 186/365] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:47:07 2021] GET /compute/v2.1/servers/54d2f913-8385-4f34-8cb0-8c0f08c7a30f => generated 1522 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 24 10:47:07.426085 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.objects.instance [None req-e7f61888-6e2e-4211-8c77-0c3168b20388 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lazy-loading 'services' on Instance uuid fb8d3af9-4513-4f65-8863-0f910fd46f04 {{(pid=123432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 24 10:47:07.501583 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-6119b2cd-9a3c-4ff0-9a52-875d938c8a18 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:47:07.502531 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-6119b2cd-9a3c-4ff0-9a52-875d938c8a18 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] [instance: 9330dbb8-edad-4d54-afeb-8badc464250d] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:47:07.511153 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-6119b2cd-9a3c-4ff0-9a52-875d938c8a18 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:07.511603 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-6119b2cd-9a3c-4ff0-9a52-875d938c8a18 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:07.512423 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-6119b2cd-9a3c-4ff0-9a52-875d938c8a18 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:07.519644 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-6119b2cd-9a3c-4ff0-9a52-875d938c8a18 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:07.699778 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-6119b2cd-9a3c-4ff0-9a52-875d938c8a18 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] 10.222.0.30 "POST /compute/v2.1/servers/9330dbb8-edad-4d54-afeb-8badc464250d/action" status: 200 len: 9443 microversion: 2.1 time: 0.201625 Dec 24 10:47:07.700940 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 187/366] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Dec 24 10:47:07 2021] POST /compute/v2.1/servers/9330dbb8-edad-4d54-afeb-8badc464250d/action => generated 9443 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 24 10:47:07.778532 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-e7f61888-6e2e-4211-8c77-0c3168b20388 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] 10.222.0.30 "DELETE /compute/v2.1/servers/fb8d3af9-4513-4f65-8863-0f910fd46f04/os-volume_attachments/300d1d50-e2cc-4856-bd5f-946fb0d1394b" status: 202 len: 0 microversion: 2.1 time: 0.524921 Dec 24 10:47:07.792454 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-1b88fbc3-6621-409d-82dd-1dc9bc7c8c7a tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:47:07.793829 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-1b88fbc3-6621-409d-82dd-1dc9bc7c8c7a tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] [instance: fb8d3af9-4513-4f65-8863-0f910fd46f04] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:47:07.797523 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 180/367] 10.222.0.30 () {58 vars in 1415 bytes} [Fri Dec 24 10:47:07 2021] DELETE /compute/v2.1/servers/fb8d3af9-4513-4f65-8863-0f910fd46f04/os-volume_attachments/300d1d50-e2cc-4856-bd5f-946fb0d1394b => generated 0 bytes in 543 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 24 10:47:07.802574 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-1b88fbc3-6621-409d-82dd-1dc9bc7c8c7a tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:07.803295 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-1b88fbc3-6621-409d-82dd-1dc9bc7c8c7a tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:07.804489 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-1b88fbc3-6621-409d-82dd-1dc9bc7c8c7a tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:07.805115 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-1b88fbc3-6621-409d-82dd-1dc9bc7c8c7a tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:07.847926 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-1b88fbc3-6621-409d-82dd-1dc9bc7c8c7a tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] 10.222.0.30 "GET /compute/v2.1/servers/fb8d3af9-4513-4f65-8863-0f910fd46f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062840 Dec 24 10:47:07.853181 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 188/368] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Dec 24 10:47:07 2021] GET /compute/v2.1/servers/fb8d3af9-4513-4f65-8863-0f910fd46f04/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 10:47:08.026075 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-dac1f490-89e8-4198-9a1e-a2756ba3b2c1 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:47:08.026670 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-dac1f490-89e8-4198-9a1e-a2756ba3b2c1 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] [instance: a99a6a98-4010-4f8e-a83f-fcc490f6ece0] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:47:08.039302 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-dac1f490-89e8-4198-9a1e-a2756ba3b2c1 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:08.040050 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-dac1f490-89e8-4198-9a1e-a2756ba3b2c1 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:08.041076 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-dac1f490-89e8-4198-9a1e-a2756ba3b2c1 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:08.041671 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-dac1f490-89e8-4198-9a1e-a2756ba3b2c1 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:08.092881 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.objects.instance [None req-dac1f490-89e8-4198-9a1e-a2756ba3b2c1 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lazy-loading 'flavor' on Instance uuid a99a6a98-4010-4f8e-a83f-fcc490f6ece0 {{(pid=123432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 24 10:47:08.356590 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-b4294a66-14cc-4a8b-9828-c80c333c95a1 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:47:08.357731 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-b4294a66-14cc-4a8b-9828-c80c333c95a1 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] [instance: 54d2f913-8385-4f34-8cb0-8c0f08c7a30f] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:47:08.368050 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-b4294a66-14cc-4a8b-9828-c80c333c95a1 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:08.369336 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-b4294a66-14cc-4a8b-9828-c80c333c95a1 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:08.370434 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-b4294a66-14cc-4a8b-9828-c80c333c95a1 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:08.371188 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-b4294a66-14cc-4a8b-9828-c80c333c95a1 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:08.572569 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-b4294a66-14cc-4a8b-9828-c80c333c95a1 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d627b760f74f48ac560e2ce2e74e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '378bb44ad89440e49f7e290a5d31004e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:47:08.585235 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-b4294a66-14cc-4a8b-9828-c80c333c95a1 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] 10.222.0.30 "GET /compute/v2.1/servers/54d2f913-8385-4f34-8cb0-8c0f08c7a30f" status: 200 len: 1522 microversion: 2.1 time: 0.233140 Dec 24 10:47:08.586389 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 189/369] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:47:08 2021] GET /compute/v2.1/servers/54d2f913-8385-4f34-8cb0-8c0f08c7a30f => generated 1522 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 24 10:47:08.713738 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-b1e10c32-5351-471d-bcb1-74c9b5558e4c tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:47:08.715311 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-b1e10c32-5351-471d-bcb1-74c9b5558e4c tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] [instance: 9330dbb8-edad-4d54-afeb-8badc464250d] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:47:08.724921 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-b1e10c32-5351-471d-bcb1-74c9b5558e4c tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:08.725371 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-b1e10c32-5351-471d-bcb1-74c9b5558e4c tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:08.729999 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-b1e10c32-5351-471d-bcb1-74c9b5558e4c tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:08.729999 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-b1e10c32-5351-471d-bcb1-74c9b5558e4c tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:08.842192 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-b1e10c32-5351-471d-bcb1-74c9b5558e4c tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] 10.222.0.30 "POST /compute/v2.1/servers/9330dbb8-edad-4d54-afeb-8badc464250d/action" status: 200 len: 15025 microversion: 2.1 time: 0.133444 Dec 24 10:47:08.844936 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 190/370] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Dec 24 10:47:08 2021] POST /compute/v2.1/servers/9330dbb8-edad-4d54-afeb-8badc464250d/action => generated 15025 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 24 10:47:08.861896 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-a99aee2d-0349-42f5-86b9-1ef39403f28e tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:47:08.865168 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-a99aee2d-0349-42f5-86b9-1ef39403f28e tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] [instance: fb8d3af9-4513-4f65-8863-0f910fd46f04] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:47:08.874368 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-a99aee2d-0349-42f5-86b9-1ef39403f28e tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:08.875005 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-a99aee2d-0349-42f5-86b9-1ef39403f28e tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:08.875968 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-a99aee2d-0349-42f5-86b9-1ef39403f28e tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:08.876633 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-a99aee2d-0349-42f5-86b9-1ef39403f28e tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:08.908762 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-dac1f490-89e8-4198-9a1e-a2756ba3b2c1 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] 10.222.0.30 "POST /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0/action" status: 202 len: 0 microversion: 2.20 time: 0.887843 Dec 24 10:47:08.909459 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 181/371] 10.222.0.30 () {62 vars in 1318 bytes} [Fri Dec 24 10:47:08 2021] POST /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0/action => generated 0 bytes in 890 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Dec 24 10:47:08.918139 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-1b5e69f3-5a4f-49cf-8541-6c3de5584faa tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:47:08.919375 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-1b5e69f3-5a4f-49cf-8541-6c3de5584faa tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] [instance: a99a6a98-4010-4f8e-a83f-fcc490f6ece0] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:47:08.927438 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-1b5e69f3-5a4f-49cf-8541-6c3de5584faa tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:08.928107 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-1b5e69f3-5a4f-49cf-8541-6c3de5584faa tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:08.929089 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-1b5e69f3-5a4f-49cf-8541-6c3de5584faa tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:08.929858 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-1b5e69f3-5a4f-49cf-8541-6c3de5584faa tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:08.953786 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-a99aee2d-0349-42f5-86b9-1ef39403f28e tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] 10.222.0.30 "GET /compute/v2.1/servers/fb8d3af9-4513-4f65-8863-0f910fd46f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.096514 Dec 24 10:47:08.955666 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 191/372] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Dec 24 10:47:08 2021] GET /compute/v2.1/servers/fb8d3af9-4513-4f65-8863-0f910fd46f04/os-volume_attachments => generated 197 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 24 10:47:09.144638 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-1b5e69f3-5a4f-49cf-8541-6c3de5584faa tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:47:09.159111 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-1b5e69f3-5a4f-49cf-8541-6c3de5584faa tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:47:09.161644 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-1b5e69f3-5a4f-49cf-8541-6c3de5584faa tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:47:09.163165 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-1b5e69f3-5a4f-49cf-8541-6c3de5584faa tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] 10.222.0.30 "GET /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0" status: 200 len: 1723 microversion: 2.20 time: 0.249192 Dec 24 10:47:09.166657 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 182/373] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Dec 24 10:47:08 2021] GET /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0 => generated 1723 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 24 10:47:09.601524 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-f754cb4f-7ebd-44fb-9b21-f1a9f1cef27e tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:47:09.602415 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-f754cb4f-7ebd-44fb-9b21-f1a9f1cef27e tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] [instance: 54d2f913-8385-4f34-8cb0-8c0f08c7a30f] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:47:09.609083 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-f754cb4f-7ebd-44fb-9b21-f1a9f1cef27e tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:09.609527 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-f754cb4f-7ebd-44fb-9b21-f1a9f1cef27e tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:09.610848 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-f754cb4f-7ebd-44fb-9b21-f1a9f1cef27e tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:09.611287 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-f754cb4f-7ebd-44fb-9b21-f1a9f1cef27e tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:09.766600 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-f754cb4f-7ebd-44fb-9b21-f1a9f1cef27e tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d627b760f74f48ac560e2ce2e74e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '378bb44ad89440e49f7e290a5d31004e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:47:09.775691 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-f754cb4f-7ebd-44fb-9b21-f1a9f1cef27e tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] 10.222.0.30 "GET /compute/v2.1/servers/54d2f913-8385-4f34-8cb0-8c0f08c7a30f" status: 200 len: 1522 microversion: 2.1 time: 0.178096 Dec 24 10:47:09.776263 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 192/374] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:47:09 2021] GET /compute/v2.1/servers/54d2f913-8385-4f34-8cb0-8c0f08c7a30f => generated 1522 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:47:09.855571 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-8b05f72c-becf-4556-a6ad-4d74832ac374 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:47:09.856979 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-8b05f72c-becf-4556-a6ad-4d74832ac374 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] [instance: 9330dbb8-edad-4d54-afeb-8badc464250d] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:47:09.864105 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-8b05f72c-becf-4556-a6ad-4d74832ac374 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:09.864857 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-8b05f72c-becf-4556-a6ad-4d74832ac374 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:09.865895 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-8b05f72c-becf-4556-a6ad-4d74832ac374 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:09.866340 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-8b05f72c-becf-4556-a6ad-4d74832ac374 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:09.968079 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-9062a954-0c99-40b2-a91d-0a62175fbd31 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:47:09.968932 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-9062a954-0c99-40b2-a91d-0a62175fbd31 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] [instance: fb8d3af9-4513-4f65-8863-0f910fd46f04] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:47:09.976283 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-9062a954-0c99-40b2-a91d-0a62175fbd31 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:09.976740 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-9062a954-0c99-40b2-a91d-0a62175fbd31 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:09.977581 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-9062a954-0c99-40b2-a91d-0a62175fbd31 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:09.978018 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-9062a954-0c99-40b2-a91d-0a62175fbd31 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:10.017666 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-9062a954-0c99-40b2-a91d-0a62175fbd31 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] 10.222.0.30 "GET /compute/v2.1/servers/fb8d3af9-4513-4f65-8863-0f910fd46f04/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.053574 Dec 24 10:47:10.022552 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 193/375] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Dec 24 10:47:09 2021] GET /compute/v2.1/servers/fb8d3af9-4513-4f65-8863-0f910fd46f04/os-volume_attachments => generated 25 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 24 10:47:10.188358 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-2edbee93-3e9f-4833-8360-ee92b02d6d05 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:47:10.189217 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-2edbee93-3e9f-4833-8360-ee92b02d6d05 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] [instance: a99a6a98-4010-4f8e-a83f-fcc490f6ece0] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:47:10.199091 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-2edbee93-3e9f-4833-8360-ee92b02d6d05 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:10.200170 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-2edbee93-3e9f-4833-8360-ee92b02d6d05 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:10.201593 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-2edbee93-3e9f-4833-8360-ee92b02d6d05 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:10.202250 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-2edbee93-3e9f-4833-8360-ee92b02d6d05 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:10.411810 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-2edbee93-3e9f-4833-8360-ee92b02d6d05 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:47:10.415226 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-2edbee93-3e9f-4833-8360-ee92b02d6d05 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:47:10.416839 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-2edbee93-3e9f-4833-8360-ee92b02d6d05 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:47:10.418765 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-2edbee93-3e9f-4833-8360-ee92b02d6d05 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] 10.222.0.30 "GET /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0" status: 200 len: 1723 microversion: 2.20 time: 0.238740 Dec 24 10:47:10.429871 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 194/376] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Dec 24 10:47:10 2021] GET /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0 => generated 1723 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 10:47:10.434743 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-45fcb395-de79-4b6e-b180-5b682c503508 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-814786149", "imageRef": "fae8172d-77c4-4f40-905a-7285c185448c", "flavorRef": "452", "networks": [{"uuid": "8016a0c6-9874-4e24-99d5-a347d449be0f"}]}} {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:47:10.490097 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.network.neutron [None req-45fcb395-de79-4b6e-b180-5b682c503508 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] validate_networks() for [('8016a0c6-9874-4e24-99d5-a347d449be0f', None, None, None, None, None)] {{(pid=123431) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 24 10:47:10.869772 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.virt.hardware [None req-45fcb395-de79-4b6e-b180-5b682c503508 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Flavor limits 0:0:0 {{(pid=123431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 24 10:47:10.870374 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.virt.hardware [None req-45fcb395-de79-4b6e-b180-5b682c503508 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Image limits 0:0:0 {{(pid=123431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 24 10:47:10.870863 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.virt.hardware [None req-45fcb395-de79-4b6e-b180-5b682c503508 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Flavor pref 0:0:0 {{(pid=123431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 24 10:47:10.871450 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.virt.hardware [None req-45fcb395-de79-4b6e-b180-5b682c503508 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Image pref 0:0:0 {{(pid=123431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 24 10:47:10.872123 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.virt.hardware [None req-45fcb395-de79-4b6e-b180-5b682c503508 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 24 10:47:10.882421 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-45fcb395-de79-4b6e-b180-5b682c503508 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:10.882903 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-45fcb395-de79-4b6e-b180-5b682c503508 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:10.883854 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-45fcb395-de79-4b6e-b180-5b682c503508 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:10.884276 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-45fcb395-de79-4b6e-b180-5b682c503508 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:10.901591 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.quota [None req-45fcb395-de79-4b6e-b180-5b682c503508 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Getting quotas for project e62d11172cdf4959a15ac1ffc5601aca. Resources: {'instances', 'cores', 'ram'} {{(pid=123431) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 24 10:47:10.905580 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.quota [None req-45fcb395-de79-4b6e-b180-5b682c503508 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Getting quotas for user 5ad5096717dc425c849dfe95ea55a6af and project e62d11172cdf4959a15ac1ffc5601aca. Resources: {'instances', 'cores', 'ram'} {{(pid=123431) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 24 10:47:10.916678 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-45fcb395-de79-4b6e-b180-5b682c503508 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Going to run 1 instances... {{(pid=123431) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 24 10:47:10.919053 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-45fcb395-de79-4b6e-b180-5b682c503508 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] [instance: d0f3b23d-c8c0-4e9a-a625-299c00fb2e27] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fae8172d-77c4-4f40-905a-7285c185448c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123431) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 24 10:47:11.115670 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-45fcb395-de79-4b6e-b180-5b682c503508 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.684691 Dec 24 10:47:11.116636 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 195/377] 10.222.0.30 () {60 vars in 1146 bytes} [Fri Dec 24 10:47:10 2021] POST /compute/v2.1/servers => generated 380 bytes in 686 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 24 10:47:11.129725 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-8a9e931c-60bc-42bf-9785-560d241954ed tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:47:11.131060 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-8a9e931c-60bc-42bf-9785-560d241954ed tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] [instance: 54d2f913-8385-4f34-8cb0-8c0f08c7a30f] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:47:11.136477 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-8a9e931c-60bc-42bf-9785-560d241954ed tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:11.136995 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-8a9e931c-60bc-42bf-9785-560d241954ed tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:11.137880 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-8a9e931c-60bc-42bf-9785-560d241954ed tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:11.138254 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-8a9e931c-60bc-42bf-9785-560d241954ed tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:11.335814 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-8a9e931c-60bc-42bf-9785-560d241954ed tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d627b760f74f48ac560e2ce2e74e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '378bb44ad89440e49f7e290a5d31004e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:47:11.343867 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-8a9e931c-60bc-42bf-9785-560d241954ed tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] 10.222.0.30 "GET /compute/v2.1/servers/54d2f913-8385-4f34-8cb0-8c0f08c7a30f" status: 200 len: 1522 microversion: 2.1 time: 0.226164 Dec 24 10:47:11.345147 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 196/378] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:47:11 2021] GET /compute/v2.1/servers/54d2f913-8385-4f34-8cb0-8c0f08c7a30f => generated 1522 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:47:11.350558 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-018b2aa4-8c8d-4036-a171-90851b758aaa tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:47:11.351156 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-018b2aa4-8c8d-4036-a171-90851b758aaa tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] [instance: d0f3b23d-c8c0-4e9a-a625-299c00fb2e27] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:47:11.402594 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-018b2aa4-8c8d-4036-a171-90851b758aaa tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ad5096717dc425c849dfe95ea55a6af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62d11172cdf4959a15ac1ffc5601aca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:47:11.410966 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-018b2aa4-8c8d-4036-a171-90851b758aaa tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] 10.222.0.30 "GET /compute/v2.1/servers/d0f3b23d-c8c0-4e9a-a625-299c00fb2e27" status: 200 len: 1217 microversion: 2.1 time: 0.064526 Dec 24 10:47:11.420128 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 197/379] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:47:11 2021] GET /compute/v2.1/servers/d0f3b23d-c8c0-4e9a-a625-299c00fb2e27 => generated 1217 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:47:11.441185 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-f7a4ac6f-80c2-4da2-a498-2ada97e27e1a tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:47:11.441967 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-f7a4ac6f-80c2-4da2-a498-2ada97e27e1a tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] [instance: a99a6a98-4010-4f8e-a83f-fcc490f6ece0] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:47:11.460633 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-f7a4ac6f-80c2-4da2-a498-2ada97e27e1a tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:11.466518 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-f7a4ac6f-80c2-4da2-a498-2ada97e27e1a tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:11.466518 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-f7a4ac6f-80c2-4da2-a498-2ada97e27e1a tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:11.466518 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-f7a4ac6f-80c2-4da2-a498-2ada97e27e1a tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:11.645719 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-f7a4ac6f-80c2-4da2-a498-2ada97e27e1a tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:47:11.668665 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-f7a4ac6f-80c2-4da2-a498-2ada97e27e1a tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:47:11.670352 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-f7a4ac6f-80c2-4da2-a498-2ada97e27e1a tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:47:11.671663 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-f7a4ac6f-80c2-4da2-a498-2ada97e27e1a tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] 10.222.0.30 "GET /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0" status: 200 len: 1723 microversion: 2.20 time: 0.238363 Dec 24 10:47:11.672801 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 198/380] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Dec 24 10:47:11 2021] GET /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0 => generated 1723 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 10:47:12.364016 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-9f663c2b-a265-4135-936c-574220d7acb6 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:47:12.365484 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-9f663c2b-a265-4135-936c-574220d7acb6 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] [instance: 54d2f913-8385-4f34-8cb0-8c0f08c7a30f] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:47:12.372370 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-9f663c2b-a265-4135-936c-574220d7acb6 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:12.372939 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-9f663c2b-a265-4135-936c-574220d7acb6 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:12.373794 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-9f663c2b-a265-4135-936c-574220d7acb6 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:12.374455 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-9f663c2b-a265-4135-936c-574220d7acb6 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:12.541599 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-9f663c2b-a265-4135-936c-574220d7acb6 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d627b760f74f48ac560e2ce2e74e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '378bb44ad89440e49f7e290a5d31004e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:47:12.550959 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-9f663c2b-a265-4135-936c-574220d7acb6 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] 10.222.0.30 "GET /compute/v2.1/servers/54d2f913-8385-4f34-8cb0-8c0f08c7a30f" status: 200 len: 1522 microversion: 2.1 time: 0.193339 Dec 24 10:47:12.551548 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 199/381] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:47:12 2021] GET /compute/v2.1/servers/54d2f913-8385-4f34-8cb0-8c0f08c7a30f => generated 1522 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:47:12.556345 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-ecac5857-ce67-4b16-9016-2777c0a3786e tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:47:12.556978 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-ecac5857-ce67-4b16-9016-2777c0a3786e tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] [instance: d0f3b23d-c8c0-4e9a-a625-299c00fb2e27] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:47:12.562998 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-ecac5857-ce67-4b16-9016-2777c0a3786e tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:12.563454 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-ecac5857-ce67-4b16-9016-2777c0a3786e tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:12.564293 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-ecac5857-ce67-4b16-9016-2777c0a3786e tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:12.571423 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-ecac5857-ce67-4b16-9016-2777c0a3786e tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:12.632648 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-ecac5857-ce67-4b16-9016-2777c0a3786e tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ad5096717dc425c849dfe95ea55a6af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62d11172cdf4959a15ac1ffc5601aca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:47:12.640923 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-ecac5857-ce67-4b16-9016-2777c0a3786e tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] 10.222.0.30 "GET /compute/v2.1/servers/d0f3b23d-c8c0-4e9a-a625-299c00fb2e27" status: 200 len: 1221 microversion: 2.1 time: 0.087761 Dec 24 10:47:12.650632 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 200/382] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:47:12 2021] GET /compute/v2.1/servers/d0f3b23d-c8c0-4e9a-a625-299c00fb2e27 => generated 1221 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:47:12.692041 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-ee4db890-f1a1-42b0-bc87-016e376ecbda tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:47:12.693032 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-ee4db890-f1a1-42b0-bc87-016e376ecbda tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] [instance: a99a6a98-4010-4f8e-a83f-fcc490f6ece0] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:47:12.699444 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-ee4db890-f1a1-42b0-bc87-016e376ecbda tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:12.699896 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-ee4db890-f1a1-42b0-bc87-016e376ecbda tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:12.700853 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-ee4db890-f1a1-42b0-bc87-016e376ecbda tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:12.701628 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-ee4db890-f1a1-42b0-bc87-016e376ecbda tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:12.856330 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-ee4db890-f1a1-42b0-bc87-016e376ecbda tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:47:12.864712 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-ee4db890-f1a1-42b0-bc87-016e376ecbda tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:47:12.866501 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-ee4db890-f1a1-42b0-bc87-016e376ecbda tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:47:12.867692 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-ee4db890-f1a1-42b0-bc87-016e376ecbda tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] 10.222.0.30 "GET /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0" status: 200 len: 1723 microversion: 2.20 time: 0.180596 Dec 24 10:47:12.868249 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 201/383] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Dec 24 10:47:12 2021] GET /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0 => generated 1723 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 10:47:13.104006 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-8b05f72c-becf-4556-a6ad-4d74832ac374 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] 10.222.0.30 "POST /compute/v2.1/servers/9330dbb8-edad-4d54-afeb-8badc464250d/action" status: 200 len: 19722 microversion: 2.1 time: 3.252011 Dec 24 10:47:13.105848 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 183/384] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Dec 24 10:47:09 2021] POST /compute/v2.1/servers/9330dbb8-edad-4d54-afeb-8badc464250d/action => generated 19722 bytes in 3254 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 24 10:47:13.569266 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-5d634394-4d14-4c7b-b792-f79481ba4b1c tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:47:13.570444 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-5d634394-4d14-4c7b-b792-f79481ba4b1c tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] [instance: 54d2f913-8385-4f34-8cb0-8c0f08c7a30f] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:47:13.578453 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-5d634394-4d14-4c7b-b792-f79481ba4b1c tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:13.579038 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-5d634394-4d14-4c7b-b792-f79481ba4b1c tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:13.579972 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-5d634394-4d14-4c7b-b792-f79481ba4b1c tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:13.580442 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-5d634394-4d14-4c7b-b792-f79481ba4b1c tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:13.657920 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-eef716b4-eff7-4679-a68e-3a943ff151b7 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:47:13.658607 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-eef716b4-eff7-4679-a68e-3a943ff151b7 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] [instance: d0f3b23d-c8c0-4e9a-a625-299c00fb2e27] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:47:13.666145 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-eef716b4-eff7-4679-a68e-3a943ff151b7 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:13.666974 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-eef716b4-eff7-4679-a68e-3a943ff151b7 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:13.667957 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-eef716b4-eff7-4679-a68e-3a943ff151b7 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:13.668611 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-eef716b4-eff7-4679-a68e-3a943ff151b7 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:13.732028 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-5d634394-4d14-4c7b-b792-f79481ba4b1c tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d627b760f74f48ac560e2ce2e74e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '378bb44ad89440e49f7e290a5d31004e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:47:13.742615 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-5d634394-4d14-4c7b-b792-f79481ba4b1c tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] 10.222.0.30 "GET /compute/v2.1/servers/54d2f913-8385-4f34-8cb0-8c0f08c7a30f" status: 200 len: 1522 microversion: 2.1 time: 0.177660 Dec 24 10:47:13.744388 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 202/385] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:47:13 2021] GET /compute/v2.1/servers/54d2f913-8385-4f34-8cb0-8c0f08c7a30f => generated 1522 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:47:13.754411 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-eef716b4-eff7-4679-a68e-3a943ff151b7 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ad5096717dc425c849dfe95ea55a6af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62d11172cdf4959a15ac1ffc5601aca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:47:13.762468 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-eef716b4-eff7-4679-a68e-3a943ff151b7 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] 10.222.0.30 "GET /compute/v2.1/servers/d0f3b23d-c8c0-4e9a-a625-299c00fb2e27" status: 200 len: 1213 microversion: 2.1 time: 0.108312 Dec 24 10:47:13.763325 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 184/386] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:47:13 2021] GET /compute/v2.1/servers/d0f3b23d-c8c0-4e9a-a625-299c00fb2e27 => generated 1213 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 24 10:47:13.886405 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-ab7f8a6b-2a94-49a2-a826-3fb3b6e79e02 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:47:13.887276 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-ab7f8a6b-2a94-49a2-a826-3fb3b6e79e02 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] [instance: a99a6a98-4010-4f8e-a83f-fcc490f6ece0] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:47:13.893360 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-ab7f8a6b-2a94-49a2-a826-3fb3b6e79e02 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:13.894035 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-ab7f8a6b-2a94-49a2-a826-3fb3b6e79e02 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:13.894964 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-ab7f8a6b-2a94-49a2-a826-3fb3b6e79e02 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:13.895542 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-ab7f8a6b-2a94-49a2-a826-3fb3b6e79e02 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:14.066421 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-ab7f8a6b-2a94-49a2-a826-3fb3b6e79e02 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:47:14.075408 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-ab7f8a6b-2a94-49a2-a826-3fb3b6e79e02 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:47:14.077344 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-ab7f8a6b-2a94-49a2-a826-3fb3b6e79e02 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:47:14.078723 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-ab7f8a6b-2a94-49a2-a826-3fb3b6e79e02 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] 10.222.0.30 "GET /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0" status: 200 len: 1723 microversion: 2.20 time: 0.195987 Dec 24 10:47:14.079584 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 203/387] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Dec 24 10:47:13 2021] GET /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0 => generated 1723 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 10:47:14.116049 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-ade79274-3939-4e73-a2bc-d851c955a312 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:47:14.117396 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-ade79274-3939-4e73-a2bc-d851c955a312 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] [instance: 9330dbb8-edad-4d54-afeb-8badc464250d] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:47:14.124177 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-ade79274-3939-4e73-a2bc-d851c955a312 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:14.124615 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-ade79274-3939-4e73-a2bc-d851c955a312 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:14.125628 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-ade79274-3939-4e73-a2bc-d851c955a312 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:14.126056 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-ade79274-3939-4e73-a2bc-d851c955a312 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:14.236449 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-ade79274-3939-4e73-a2bc-d851c955a312 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] 10.222.0.30 "POST /compute/v2.1/servers/9330dbb8-edad-4d54-afeb-8badc464250d/action" status: 200 len: 21656 microversion: 2.1 time: 0.124435 Dec 24 10:47:14.237889 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 185/388] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Dec 24 10:47:14 2021] POST /compute/v2.1/servers/9330dbb8-edad-4d54-afeb-8badc464250d/action => generated 21656 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 24 10:47:14.759615 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-973c2100-0f7f-475a-acba-9714c3af6b00 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:47:14.760222 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-973c2100-0f7f-475a-acba-9714c3af6b00 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] [instance: 54d2f913-8385-4f34-8cb0-8c0f08c7a30f] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:47:14.766608 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-973c2100-0f7f-475a-acba-9714c3af6b00 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:14.767059 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-973c2100-0f7f-475a-acba-9714c3af6b00 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:14.767830 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-973c2100-0f7f-475a-acba-9714c3af6b00 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:14.768269 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-973c2100-0f7f-475a-acba-9714c3af6b00 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:14.779556 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-32dbd930-2f32-46ed-8bd1-4d9f0c2419ed tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:47:14.780251 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-32dbd930-2f32-46ed-8bd1-4d9f0c2419ed tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] [instance: d0f3b23d-c8c0-4e9a-a625-299c00fb2e27] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:47:14.787776 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-32dbd930-2f32-46ed-8bd1-4d9f0c2419ed tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:14.788230 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-32dbd930-2f32-46ed-8bd1-4d9f0c2419ed tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:14.789051 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-32dbd930-2f32-46ed-8bd1-4d9f0c2419ed tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:14.789484 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-32dbd930-2f32-46ed-8bd1-4d9f0c2419ed tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:14.850299 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-32dbd930-2f32-46ed-8bd1-4d9f0c2419ed tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ad5096717dc425c849dfe95ea55a6af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62d11172cdf4959a15ac1ffc5601aca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:47:14.858488 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-32dbd930-2f32-46ed-8bd1-4d9f0c2419ed tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] 10.222.0.30 "GET /compute/v2.1/servers/d0f3b23d-c8c0-4e9a-a625-299c00fb2e27" status: 200 len: 1213 microversion: 2.1 time: 0.082808 Dec 24 10:47:14.864018 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 186/389] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:47:14 2021] GET /compute/v2.1/servers/d0f3b23d-c8c0-4e9a-a625-299c00fb2e27 => generated 1213 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 24 10:47:14.912839 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-973c2100-0f7f-475a-acba-9714c3af6b00 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d627b760f74f48ac560e2ce2e74e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '378bb44ad89440e49f7e290a5d31004e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:47:14.919941 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-973c2100-0f7f-475a-acba-9714c3af6b00 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] 10.222.0.30 "GET /compute/v2.1/servers/54d2f913-8385-4f34-8cb0-8c0f08c7a30f" status: 200 len: 1502 microversion: 2.1 time: 0.164184 Dec 24 10:47:14.920499 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 204/390] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:47:14 2021] GET /compute/v2.1/servers/54d2f913-8385-4f34-8cb0-8c0f08c7a30f => generated 1502 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:47:14.936120 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-51cee09e-6da8-4e39-94f5-83fc8242cdfd tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b43210bf-7b3b-4af6-b0f6-e5a485f229fa"}} {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:47:14.937203 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-51cee09e-6da8-4e39-94f5-83fc8242cdfd tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] [instance: 54d2f913-8385-4f34-8cb0-8c0f08c7a30f] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:47:14.943436 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-51cee09e-6da8-4e39-94f5-83fc8242cdfd tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:14.943871 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-51cee09e-6da8-4e39-94f5-83fc8242cdfd tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:14.944636 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-51cee09e-6da8-4e39-94f5-83fc8242cdfd tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:14.945084 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-51cee09e-6da8-4e39-94f5-83fc8242cdfd tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:14.967831 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.wsgi [None req-51cee09e-6da8-4e39-94f5-83fc8242cdfd tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] HTTP exception thrown: Cannot 'attach_volume' instance 54d2f913-8385-4f34-8cb0-8c0f08c7a30f while it is in vm_state rescued Dec 24 10:47:14.977845 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-51cee09e-6da8-4e39-94f5-83fc8242cdfd tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Returning 409 to user: Cannot 'attach_volume' instance 54d2f913-8385-4f34-8cb0-8c0f08c7a30f while it is in vm_state rescued {{(pid=123432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 24 10:47:14.977845 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-51cee09e-6da8-4e39-94f5-83fc8242cdfd tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] 10.222.0.30 "POST /compute/v2.1/servers/54d2f913-8385-4f34-8cb0-8c0f08c7a30f/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.036995 Dec 24 10:47:14.977845 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 187/391] 10.222.0.30 () {60 vars in 1322 bytes} [Fri Dec 24 10:47:14 2021] POST /compute/v2.1/servers/54d2f913-8385-4f34-8cb0-8c0f08c7a30f/os-volume_attachments => generated 152 bytes in 38 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Dec 24 10:47:14.985010 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-dd7e2eaa-dc1b-4fe0-91b8-26d18b2b4d3b tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:47:14.985537 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-dd7e2eaa-dc1b-4fe0-91b8-26d18b2b4d3b tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] [instance: 54d2f913-8385-4f34-8cb0-8c0f08c7a30f] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:47:14.991328 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-dd7e2eaa-dc1b-4fe0-91b8-26d18b2b4d3b tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:14.991767 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-dd7e2eaa-dc1b-4fe0-91b8-26d18b2b4d3b tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:14.992534 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-dd7e2eaa-dc1b-4fe0-91b8-26d18b2b4d3b tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:14.993001 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-dd7e2eaa-dc1b-4fe0-91b8-26d18b2b4d3b tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:15.098969 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-1ae5e497-48aa-40a6-8e9d-7349a9e5baf7 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:47:15.099570 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-1ae5e497-48aa-40a6-8e9d-7349a9e5baf7 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] [instance: a99a6a98-4010-4f8e-a83f-fcc490f6ece0] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:47:15.121464 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-1ae5e497-48aa-40a6-8e9d-7349a9e5baf7 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:15.122592 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-1ae5e497-48aa-40a6-8e9d-7349a9e5baf7 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:15.123728 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-1ae5e497-48aa-40a6-8e9d-7349a9e5baf7 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:15.124428 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-1ae5e497-48aa-40a6-8e9d-7349a9e5baf7 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:15.249482 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-dd7e2eaa-dc1b-4fe0-91b8-26d18b2b4d3b tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] 10.222.0.30 "POST /compute/v2.1/servers/54d2f913-8385-4f34-8cb0-8c0f08c7a30f/action" status: 202 len: 0 microversion: 2.1 time: 0.267803 Dec 24 10:47:15.250918 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 205/392] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Dec 24 10:47:14 2021] POST /compute/v2.1/servers/54d2f913-8385-4f34-8cb0-8c0f08c7a30f/action => generated 0 bytes in 270 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 24 10:47:15.261063 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-e15e04d4-65af-4e4c-bfa7-726454939f38 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:47:15.265999 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-e15e04d4-65af-4e4c-bfa7-726454939f38 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] [instance: 9330dbb8-edad-4d54-afeb-8badc464250d] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:47:15.285079 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-e15e04d4-65af-4e4c-bfa7-726454939f38 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:15.285756 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-e15e04d4-65af-4e4c-bfa7-726454939f38 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:15.301414 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-e15e04d4-65af-4e4c-bfa7-726454939f38 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:15.302028 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-e15e04d4-65af-4e4c-bfa7-726454939f38 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:15.347409 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-1ae5e497-48aa-40a6-8e9d-7349a9e5baf7 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:47:15.355678 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-1ae5e497-48aa-40a6-8e9d-7349a9e5baf7 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:47:15.357199 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-1ae5e497-48aa-40a6-8e9d-7349a9e5baf7 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:47:15.358632 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-1ae5e497-48aa-40a6-8e9d-7349a9e5baf7 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] 10.222.0.30 "GET /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0" status: 200 len: 1723 microversion: 2.20 time: 0.263637 Dec 24 10:47:15.359976 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 188/393] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Dec 24 10:47:15 2021] GET /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0 => generated 1723 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 24 10:47:15.372517 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-ba9a8fec-9528-4d04-958b-38736736aab2 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:47:15.374635 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-ba9a8fec-9528-4d04-958b-38736736aab2 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] [instance: 54d2f913-8385-4f34-8cb0-8c0f08c7a30f] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:47:15.381698 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-ba9a8fec-9528-4d04-958b-38736736aab2 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:15.382148 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-ba9a8fec-9528-4d04-958b-38736736aab2 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:15.382938 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-ba9a8fec-9528-4d04-958b-38736736aab2 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:15.383486 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-ba9a8fec-9528-4d04-958b-38736736aab2 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:15.403036 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-e15e04d4-65af-4e4c-bfa7-726454939f38 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] 10.222.0.30 "POST /compute/v2.1/servers/9330dbb8-edad-4d54-afeb-8badc464250d/action" status: 200 len: 22878 microversion: 2.1 time: 0.150441 Dec 24 10:47:15.404049 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 206/394] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Dec 24 10:47:15 2021] POST /compute/v2.1/servers/9330dbb8-edad-4d54-afeb-8badc464250d/action => generated 22878 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 24 10:47:15.677015 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-ba9a8fec-9528-4d04-958b-38736736aab2 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d627b760f74f48ac560e2ce2e74e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '378bb44ad89440e49f7e290a5d31004e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:47:15.700220 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-ba9a8fec-9528-4d04-958b-38736736aab2 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] 10.222.0.30 "GET /compute/v2.1/servers/54d2f913-8385-4f34-8cb0-8c0f08c7a30f" status: 200 len: 1510 microversion: 2.1 time: 0.338859 Dec 24 10:47:15.700848 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 189/395] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:47:15 2021] GET /compute/v2.1/servers/54d2f913-8385-4f34-8cb0-8c0f08c7a30f => generated 1510 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:47:15.875493 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-c91dc1c5-b670-429e-b973-2afe95a6dbb1 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:47:15.876228 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-c91dc1c5-b670-429e-b973-2afe95a6dbb1 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] [instance: d0f3b23d-c8c0-4e9a-a625-299c00fb2e27] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:47:15.883235 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-c91dc1c5-b670-429e-b973-2afe95a6dbb1 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:15.883677 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-c91dc1c5-b670-429e-b973-2afe95a6dbb1 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:15.884455 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-c91dc1c5-b670-429e-b973-2afe95a6dbb1 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:15.885081 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-c91dc1c5-b670-429e-b973-2afe95a6dbb1 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:15.950691 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-c91dc1c5-b670-429e-b973-2afe95a6dbb1 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ad5096717dc425c849dfe95ea55a6af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62d11172cdf4959a15ac1ffc5601aca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:47:15.958471 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-c91dc1c5-b670-429e-b973-2afe95a6dbb1 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] 10.222.0.30 "GET /compute/v2.1/servers/d0f3b23d-c8c0-4e9a-a625-299c00fb2e27" status: 200 len: 1269 microversion: 2.1 time: 0.086954 Dec 24 10:47:15.959029 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 207/396] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:47:15 2021] GET /compute/v2.1/servers/d0f3b23d-c8c0-4e9a-a625-299c00fb2e27 => generated 1269 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:47:16.378088 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-ac7bb445-874e-4e46-a116-f6de349afb28 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:47:16.378716 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-ac7bb445-874e-4e46-a116-f6de349afb28 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] [instance: a99a6a98-4010-4f8e-a83f-fcc490f6ece0] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:47:16.385286 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-ac7bb445-874e-4e46-a116-f6de349afb28 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:16.385727 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-ac7bb445-874e-4e46-a116-f6de349afb28 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:16.386501 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-ac7bb445-874e-4e46-a116-f6de349afb28 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:16.386928 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-ac7bb445-874e-4e46-a116-f6de349afb28 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:16.419494 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-457eed79-b9a5-413b-bbf4-dc55cccd9c20 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:47:16.423076 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-457eed79-b9a5-413b-bbf4-dc55cccd9c20 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] [instance: 9330dbb8-edad-4d54-afeb-8badc464250d] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:47:16.429251 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-457eed79-b9a5-413b-bbf4-dc55cccd9c20 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:16.429776 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-457eed79-b9a5-413b-bbf4-dc55cccd9c20 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:16.430641 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-457eed79-b9a5-413b-bbf4-dc55cccd9c20 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:16.431149 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-457eed79-b9a5-413b-bbf4-dc55cccd9c20 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:16.571202 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-457eed79-b9a5-413b-bbf4-dc55cccd9c20 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] 10.222.0.30 "POST /compute/v2.1/servers/9330dbb8-edad-4d54-afeb-8badc464250d/action" status: 200 len: 23785 microversion: 2.1 time: 0.158867 Dec 24 10:47:16.573073 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 208/397] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Dec 24 10:47:16 2021] POST /compute/v2.1/servers/9330dbb8-edad-4d54-afeb-8badc464250d/action => generated 23785 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 24 10:47:16.578846 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-debbc6a0-9312-458a-8d84-960f86e95f29 tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Action: 'create', calling method: .version_select at 0x7f1899d1ca60>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1333698510"}} {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:47:16.594984 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.quota [None req-debbc6a0-9312-458a-8d84-960f86e95f29 tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Getting quotas for project aed29a38d2fe424398ac10e585a980df. Resources: {'key_pairs'} {{(pid=123431) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 24 10:47:16.598926 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.quota [None req-debbc6a0-9312-458a-8d84-960f86e95f29 tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Getting quotas for user 7e2194bc8c0d44b186956c1b38a0c04a and project aed29a38d2fe424398ac10e585a980df. Resources: {'key_pairs'} {{(pid=123431) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 24 10:47:16.612151 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-ac7bb445-874e-4e46-a116-f6de349afb28 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:47:16.620050 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-ac7bb445-874e-4e46-a116-f6de349afb28 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:47:16.621552 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-ac7bb445-874e-4e46-a116-f6de349afb28 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:47:16.624849 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-ac7bb445-874e-4e46-a116-f6de349afb28 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] 10.222.0.30 "GET /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0" status: 200 len: 1723 microversion: 2.20 time: 0.248583 Dec 24 10:47:16.624849 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 190/398] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Dec 24 10:47:16 2021] GET /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0 => generated 1723 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 10:47:16.717869 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-3ffbe616-41cc-472a-8df7-4d8b782ce667 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:47:16.718669 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-3ffbe616-41cc-472a-8df7-4d8b782ce667 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] [instance: 54d2f913-8385-4f34-8cb0-8c0f08c7a30f] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:47:16.726424 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-3ffbe616-41cc-472a-8df7-4d8b782ce667 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:16.728202 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-3ffbe616-41cc-472a-8df7-4d8b782ce667 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:16.729154 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-3ffbe616-41cc-472a-8df7-4d8b782ce667 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:16.729644 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-3ffbe616-41cc-472a-8df7-4d8b782ce667 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:16.969910 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-3ffbe616-41cc-472a-8df7-4d8b782ce667 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d627b760f74f48ac560e2ce2e74e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '378bb44ad89440e49f7e290a5d31004e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:47:16.978971 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-3ffbe616-41cc-472a-8df7-4d8b782ce667 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] 10.222.0.30 "GET /compute/v2.1/servers/54d2f913-8385-4f34-8cb0-8c0f08c7a30f" status: 200 len: 1510 microversion: 2.1 time: 0.265126 Dec 24 10:47:16.979626 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 191/399] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:47:16 2021] GET /compute/v2.1/servers/54d2f913-8385-4f34-8cb0-8c0f08c7a30f => generated 1510 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 24 10:47:16.983887 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-4d5fa918-98d9-4976-a6ad-83d48a52cc16 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:47:16.984590 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-4d5fa918-98d9-4976-a6ad-83d48a52cc16 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] [instance: d0f3b23d-c8c0-4e9a-a625-299c00fb2e27] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:47:16.991182 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-4d5fa918-98d9-4976-a6ad-83d48a52cc16 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:16.991632 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-4d5fa918-98d9-4976-a6ad-83d48a52cc16 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:16.992406 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-4d5fa918-98d9-4976-a6ad-83d48a52cc16 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:16.993254 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-4d5fa918-98d9-4976-a6ad-83d48a52cc16 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:17.038789 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.quota [None req-debbc6a0-9312-458a-8d84-960f86e95f29 tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Getting quotas for project aed29a38d2fe424398ac10e585a980df. Resources: {'key_pairs'} {{(pid=123431) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 24 10:47:17.043102 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.quota [None req-debbc6a0-9312-458a-8d84-960f86e95f29 tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Getting quotas for user 7e2194bc8c0d44b186956c1b38a0c04a and project aed29a38d2fe424398ac10e585a980df. Resources: {'key_pairs'} {{(pid=123431) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 24 10:47:17.055911 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-debbc6a0-9312-458a-8d84-960f86e95f29 tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 2318 microversion: 2.1 time: 0.481585 Dec 24 10:47:17.056525 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 209/400] 10.222.0.30 () {60 vars in 1157 bytes} [Fri Dec 24 10:47:16 2021] POST /compute/v2.1/os-keypairs => generated 2318 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:47:17.076197 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-4d5fa918-98d9-4976-a6ad-83d48a52cc16 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ad5096717dc425c849dfe95ea55a6af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62d11172cdf4959a15ac1ffc5601aca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:47:17.082145 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-4d5fa918-98d9-4976-a6ad-83d48a52cc16 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] 10.222.0.30 "GET /compute/v2.1/servers/d0f3b23d-c8c0-4e9a-a625-299c00fb2e27" status: 200 len: 1275 microversion: 2.1 time: 0.101532 Dec 24 10:47:17.082792 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 192/401] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:47:16 2021] GET /compute/v2.1/servers/d0f3b23d-c8c0-4e9a-a625-299c00fb2e27 => generated 1275 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:47:17.152511 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-3ea944f7-1aee-4993-a120-4cae454404ad tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1932694651", "imageRef": "f6827ba7-e871-471e-b000-8e26ad9d2fae", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1333698510", "networks": [{"uuid": "bdfb7371-0493-476c-b7e5-4ee84d9bf130"}]}} {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:47:17.203241 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.network.neutron [None req-3ea944f7-1aee-4993-a120-4cae454404ad tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] validate_networks() for [('bdfb7371-0493-476c-b7e5-4ee84d9bf130', None, None, None, None, None)] {{(pid=123431) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 24 10:47:17.587528 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-e08b4995-c457-414f-b8ad-64a5605a488f tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:47:17.588702 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-e08b4995-c457-414f-b8ad-64a5605a488f tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] [instance: 9330dbb8-edad-4d54-afeb-8badc464250d] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:47:17.595986 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-e08b4995-c457-414f-b8ad-64a5605a488f tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:17.596442 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-e08b4995-c457-414f-b8ad-64a5605a488f tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:17.603153 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-e08b4995-c457-414f-b8ad-64a5605a488f tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:17.603609 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-e08b4995-c457-414f-b8ad-64a5605a488f tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:17.622825 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.virt.hardware [None req-3ea944f7-1aee-4993-a120-4cae454404ad tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Flavor limits 0:0:0 {{(pid=123431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 24 10:47:17.623599 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.virt.hardware [None req-3ea944f7-1aee-4993-a120-4cae454404ad tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Image limits 0:0:0 {{(pid=123431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 24 10:47:17.625098 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.virt.hardware [None req-3ea944f7-1aee-4993-a120-4cae454404ad tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Flavor pref 0:0:0 {{(pid=123431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 24 10:47:17.625503 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.virt.hardware [None req-3ea944f7-1aee-4993-a120-4cae454404ad tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Image pref 0:0:0 {{(pid=123431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 24 10:47:17.625910 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.virt.hardware [None req-3ea944f7-1aee-4993-a120-4cae454404ad tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 24 10:47:17.640870 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-3ea944f7-1aee-4993-a120-4cae454404ad tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:17.641314 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-3ea944f7-1aee-4993-a120-4cae454404ad tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:17.642114 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-3ea944f7-1aee-4993-a120-4cae454404ad tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:17.643194 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-3ea944f7-1aee-4993-a120-4cae454404ad tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:17.672277 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.quota [None req-3ea944f7-1aee-4993-a120-4cae454404ad tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Getting quotas for project aed29a38d2fe424398ac10e585a980df. Resources: {'instances', 'cores', 'ram'} {{(pid=123431) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 24 10:47:17.676407 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.quota [None req-3ea944f7-1aee-4993-a120-4cae454404ad tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Getting quotas for user 7e2194bc8c0d44b186956c1b38a0c04a and project aed29a38d2fe424398ac10e585a980df. Resources: {'instances', 'cores', 'ram'} {{(pid=123431) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 24 10:47:17.687561 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-3ea944f7-1aee-4993-a120-4cae454404ad tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Going to run 1 instances... {{(pid=123431) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 24 10:47:17.689980 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-3ea944f7-1aee-4993-a120-4cae454404ad tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] [instance: 12183d8e-4c50-449a-a93d-cee72f597b3d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f6827ba7-e871-471e-b000-8e26ad9d2fae',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123431) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 24 10:47:17.696539 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-e08b4995-c457-414f-b8ad-64a5605a488f tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] 10.222.0.30 "POST /compute/v2.1/servers/9330dbb8-edad-4d54-afeb-8badc464250d/action" status: 200 len: 24291 microversion: 2.1 time: 0.113349 Dec 24 10:47:17.701121 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 193/402] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Dec 24 10:47:17 2021] POST /compute/v2.1/servers/9330dbb8-edad-4d54-afeb-8badc464250d/action => generated 24291 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 24 10:47:17.707770 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-fb75773d-9c66-4397-9309-9037e7616550 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:47:17.708729 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-fb75773d-9c66-4397-9309-9037e7616550 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] [instance: a99a6a98-4010-4f8e-a83f-fcc490f6ece0] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:47:17.724679 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-fb75773d-9c66-4397-9309-9037e7616550 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:17.725761 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-fb75773d-9c66-4397-9309-9037e7616550 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:17.726012 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-fb75773d-9c66-4397-9309-9037e7616550 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:17.726443 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-fb75773d-9c66-4397-9309-9037e7616550 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:17.842491 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-3ea944f7-1aee-4993-a120-4cae454404ad tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.693637 Dec 24 10:47:17.843202 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 210/403] 10.222.0.30 () {60 vars in 1146 bytes} [Fri Dec 24 10:47:17 2021] POST /compute/v2.1/servers => generated 380 bytes in 695 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 24 10:47:17.852592 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-7fa67bd5-2ece-4393-ba3e-f540dccb8c80 tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:47:17.853225 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-7fa67bd5-2ece-4393-ba3e-f540dccb8c80 tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] [instance: 12183d8e-4c50-449a-a93d-cee72f597b3d] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:47:17.908865 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-7fa67bd5-2ece-4393-ba3e-f540dccb8c80 tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e2194bc8c0d44b186956c1b38a0c04a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed29a38d2fe424398ac10e585a980df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:47:17.930119 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-7fa67bd5-2ece-4393-ba3e-f540dccb8c80 tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] 10.222.0.30 "GET /compute/v2.1/servers/12183d8e-4c50-449a-a93d-cee72f597b3d" status: 200 len: 1259 microversion: 2.1 time: 0.079995 Dec 24 10:47:17.930833 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 211/404] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:47:17 2021] GET /compute/v2.1/servers/12183d8e-4c50-449a-a93d-cee72f597b3d => generated 1259 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 24 10:47:17.940077 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-fb75773d-9c66-4397-9309-9037e7616550 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:47:17.951258 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-fb75773d-9c66-4397-9309-9037e7616550 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:47:17.952874 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-fb75773d-9c66-4397-9309-9037e7616550 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:47:17.954115 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-fb75773d-9c66-4397-9309-9037e7616550 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] 10.222.0.30 "GET /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0" status: 200 len: 1723 microversion: 2.20 time: 0.251015 Dec 24 10:47:17.954930 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 194/405] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Dec 24 10:47:17 2021] GET /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0 => generated 1723 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 10:47:17.995682 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-abbf4d54-13a3-4eac-a546-f06413906f52 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:47:17.996420 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-abbf4d54-13a3-4eac-a546-f06413906f52 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] [instance: 54d2f913-8385-4f34-8cb0-8c0f08c7a30f] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:47:18.011836 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-abbf4d54-13a3-4eac-a546-f06413906f52 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:18.012295 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-abbf4d54-13a3-4eac-a546-f06413906f52 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:18.013134 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-abbf4d54-13a3-4eac-a546-f06413906f52 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:18.013698 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-abbf4d54-13a3-4eac-a546-f06413906f52 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:18.099611 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-a05419ed-eafc-4c9f-8674-399422f4deb0 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:47:18.100400 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-a05419ed-eafc-4c9f-8674-399422f4deb0 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] [instance: d0f3b23d-c8c0-4e9a-a625-299c00fb2e27] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:47:18.107164 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-a05419ed-eafc-4c9f-8674-399422f4deb0 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:18.107677 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-a05419ed-eafc-4c9f-8674-399422f4deb0 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:18.110355 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-a05419ed-eafc-4c9f-8674-399422f4deb0 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:18.110355 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-a05419ed-eafc-4c9f-8674-399422f4deb0 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:18.173349 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-abbf4d54-13a3-4eac-a546-f06413906f52 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d627b760f74f48ac560e2ce2e74e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '378bb44ad89440e49f7e290a5d31004e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:47:18.181173 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-abbf4d54-13a3-4eac-a546-f06413906f52 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] 10.222.0.30 "GET /compute/v2.1/servers/54d2f913-8385-4f34-8cb0-8c0f08c7a30f" status: 200 len: 1510 microversion: 2.1 time: 0.189532 Dec 24 10:47:18.181741 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 212/406] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:47:17 2021] GET /compute/v2.1/servers/54d2f913-8385-4f34-8cb0-8c0f08c7a30f => generated 1510 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 24 10:47:18.313544 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-a05419ed-eafc-4c9f-8674-399422f4deb0 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ad5096717dc425c849dfe95ea55a6af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62d11172cdf4959a15ac1ffc5601aca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:47:18.320843 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-a05419ed-eafc-4c9f-8674-399422f4deb0 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] 10.222.0.30 "GET /compute/v2.1/servers/d0f3b23d-c8c0-4e9a-a625-299c00fb2e27" status: 200 len: 1317 microversion: 2.1 time: 0.225613 Dec 24 10:47:18.321448 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 195/407] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:47:18 2021] GET /compute/v2.1/servers/d0f3b23d-c8c0-4e9a-a625-299c00fb2e27 => generated 1317 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 24 10:47:18.557901 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [req-9fadd053-325a-4709-925c-a3b9e34b69de req-99ad8d8a-94cb-4dd1-bf51-03b5de20dba3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d0f3b23d-c8c0-4e9a-a625-299c00fb2e27", "tag": "4fde9d66-dead-4e85-8d7f-9dffb8700f99"}]} {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:47:18.560094 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 10:47:18.560094 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: warnings.warn(msg) Dec 24 10:47:18.568750 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [req-9fadd053-325a-4709-925c-a3b9e34b69de req-99ad8d8a-94cb-4dd1-bf51-03b5de20dba3 service nova] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:18.569075 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [req-9fadd053-325a-4709-925c-a3b9e34b69de req-99ad8d8a-94cb-4dd1-bf51-03b5de20dba3 service nova] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:18.587590 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.compute.server_external_events [req-9fadd053-325a-4709-925c-a3b9e34b69de req-99ad8d8a-94cb-4dd1-bf51-03b5de20dba3 service nova] Creating event network-changed:4fde9d66-dead-4e85-8d7f-9dffb8700f99 for instance d0f3b23d-c8c0-4e9a-a625-299c00fb2e27 on hv-cinder-81644 Dec 24 10:47:18.594216 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [req-9fadd053-325a-4709-925c-a3b9e34b69de req-99ad8d8a-94cb-4dd1-bf51-03b5de20dba3 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040081 Dec 24 10:47:18.597842 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 213/408] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Dec 24 10:47:18 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 24 10:47:18.707980 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-9dbe1abb-ddda-4767-a5f4-b770e09865bc tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:47:18.709092 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-9dbe1abb-ddda-4767-a5f4-b770e09865bc tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] [instance: 9330dbb8-edad-4d54-afeb-8badc464250d] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:47:18.715570 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-9dbe1abb-ddda-4767-a5f4-b770e09865bc tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:18.716091 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-9dbe1abb-ddda-4767-a5f4-b770e09865bc tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:18.717004 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-9dbe1abb-ddda-4767-a5f4-b770e09865bc tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:18.717502 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-9dbe1abb-ddda-4767-a5f4-b770e09865bc tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:18.876853 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-9dbe1abb-ddda-4767-a5f4-b770e09865bc tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] 10.222.0.30 "POST /compute/v2.1/servers/9330dbb8-edad-4d54-afeb-8badc464250d/action" status: 200 len: 25018 microversion: 2.1 time: 0.172814 Dec 24 10:47:18.877515 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 196/409] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Dec 24 10:47:18 2021] POST /compute/v2.1/servers/9330dbb8-edad-4d54-afeb-8badc464250d/action => generated 25018 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 24 10:47:18.947438 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-f2e98d5e-9259-43f1-b7aa-159c1d140735 tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:47:18.948125 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-f2e98d5e-9259-43f1-b7aa-159c1d140735 tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] [instance: 12183d8e-4c50-449a-a93d-cee72f597b3d] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:47:18.974552 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-9ac9187b-29b4-45f9-b439-3d23e9223741 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:47:18.974552 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-9ac9187b-29b4-45f9-b439-3d23e9223741 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] [instance: a99a6a98-4010-4f8e-a83f-fcc490f6ece0] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:47:18.980853 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-9ac9187b-29b4-45f9-b439-3d23e9223741 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:18.981487 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-9ac9187b-29b4-45f9-b439-3d23e9223741 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:18.982477 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-9ac9187b-29b4-45f9-b439-3d23e9223741 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:18.982907 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-9ac9187b-29b4-45f9-b439-3d23e9223741 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:19.009276 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-f2e98d5e-9259-43f1-b7aa-159c1d140735 tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e2194bc8c0d44b186956c1b38a0c04a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed29a38d2fe424398ac10e585a980df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:47:19.015881 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-f2e98d5e-9259-43f1-b7aa-159c1d140735 tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] 10.222.0.30 "GET /compute/v2.1/servers/12183d8e-4c50-449a-a93d-cee72f597b3d" status: 200 len: 1259 microversion: 2.1 time: 0.072590 Dec 24 10:47:19.018023 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 214/410] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:47:18 2021] GET /compute/v2.1/servers/12183d8e-4c50-449a-a93d-cee72f597b3d => generated 1259 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:47:19.194233 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-9ac9187b-29b4-45f9-b439-3d23e9223741 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:47:19.198580 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-6617b0d5-a9a6-4ef4-9c7e-d2ba41fefbc4 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:47:19.199912 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-6617b0d5-a9a6-4ef4-9c7e-d2ba41fefbc4 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] [instance: 54d2f913-8385-4f34-8cb0-8c0f08c7a30f] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:47:19.206831 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-6617b0d5-a9a6-4ef4-9c7e-d2ba41fefbc4 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:19.207271 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-6617b0d5-a9a6-4ef4-9c7e-d2ba41fefbc4 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:19.208055 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-6617b0d5-a9a6-4ef4-9c7e-d2ba41fefbc4 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:19.208520 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-6617b0d5-a9a6-4ef4-9c7e-d2ba41fefbc4 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:19.212047 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-9ac9187b-29b4-45f9-b439-3d23e9223741 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:47:19.213647 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-9ac9187b-29b4-45f9-b439-3d23e9223741 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:47:19.214894 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-9ac9187b-29b4-45f9-b439-3d23e9223741 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] 10.222.0.30 "GET /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0" status: 200 len: 1723 microversion: 2.20 time: 0.246566 Dec 24 10:47:19.215532 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 197/411] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Dec 24 10:47:18 2021] GET /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0 => generated 1723 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 24 10:47:19.338096 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-e228ccb9-75e9-4d38-b618-5f268e0a10c0 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:47:19.338613 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-e228ccb9-75e9-4d38-b618-5f268e0a10c0 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] [instance: d0f3b23d-c8c0-4e9a-a625-299c00fb2e27] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:47:19.347259 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-e228ccb9-75e9-4d38-b618-5f268e0a10c0 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:19.347967 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-e228ccb9-75e9-4d38-b618-5f268e0a10c0 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:19.348751 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-e228ccb9-75e9-4d38-b618-5f268e0a10c0 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:19.349206 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-e228ccb9-75e9-4d38-b618-5f268e0a10c0 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:19.358234 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-6617b0d5-a9a6-4ef4-9c7e-d2ba41fefbc4 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d627b760f74f48ac560e2ce2e74e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '378bb44ad89440e49f7e290a5d31004e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:47:19.366813 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-6617b0d5-a9a6-4ef4-9c7e-d2ba41fefbc4 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] 10.222.0.30 "GET /compute/v2.1/servers/54d2f913-8385-4f34-8cb0-8c0f08c7a30f" status: 200 len: 1516 microversion: 2.1 time: 0.172423 Dec 24 10:47:19.367419 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 215/412] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:47:19 2021] GET /compute/v2.1/servers/54d2f913-8385-4f34-8cb0-8c0f08c7a30f => generated 1516 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 24 10:47:19.552845 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-e228ccb9-75e9-4d38-b618-5f268e0a10c0 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ad5096717dc425c849dfe95ea55a6af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62d11172cdf4959a15ac1ffc5601aca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:47:19.560482 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-e228ccb9-75e9-4d38-b618-5f268e0a10c0 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] 10.222.0.30 "GET /compute/v2.1/servers/d0f3b23d-c8c0-4e9a-a625-299c00fb2e27" status: 200 len: 1317 microversion: 2.1 time: 0.226385 Dec 24 10:47:19.561076 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 198/413] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:47:19 2021] GET /compute/v2.1/servers/d0f3b23d-c8c0-4e9a-a625-299c00fb2e27 => generated 1317 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 24 10:47:19.888307 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-91f89b0d-0062-47ce-b771-29c26030e806 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:47:19.889603 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-91f89b0d-0062-47ce-b771-29c26030e806 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] [instance: 9330dbb8-edad-4d54-afeb-8badc464250d] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:47:19.898126 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-91f89b0d-0062-47ce-b771-29c26030e806 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:19.898565 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-91f89b0d-0062-47ce-b771-29c26030e806 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:19.899390 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-91f89b0d-0062-47ce-b771-29c26030e806 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:19.900251 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-91f89b0d-0062-47ce-b771-29c26030e806 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:19.997035 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-91f89b0d-0062-47ce-b771-29c26030e806 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] 10.222.0.30 "POST /compute/v2.1/servers/9330dbb8-edad-4d54-afeb-8badc464250d/action" status: 200 len: 25845 microversion: 2.1 time: 0.112448 Dec 24 10:47:19.997679 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 216/414] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Dec 24 10:47:19 2021] POST /compute/v2.1/servers/9330dbb8-edad-4d54-afeb-8badc464250d/action => generated 25845 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 24 10:47:20.032341 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-f33139c4-c348-475f-8a05-cccf83fe7ed2 tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:47:20.032981 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-f33139c4-c348-475f-8a05-cccf83fe7ed2 tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] [instance: 12183d8e-4c50-449a-a93d-cee72f597b3d] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:47:20.039467 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-f33139c4-c348-475f-8a05-cccf83fe7ed2 tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:20.040008 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-f33139c4-c348-475f-8a05-cccf83fe7ed2 tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:20.040800 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-f33139c4-c348-475f-8a05-cccf83fe7ed2 tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:20.041279 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-f33139c4-c348-475f-8a05-cccf83fe7ed2 tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:20.110122 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-f33139c4-c348-475f-8a05-cccf83fe7ed2 tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e2194bc8c0d44b186956c1b38a0c04a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed29a38d2fe424398ac10e585a980df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:47:20.118923 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-f33139c4-c348-475f-8a05-cccf83fe7ed2 tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] 10.222.0.30 "GET /compute/v2.1/servers/12183d8e-4c50-449a-a93d-cee72f597b3d" status: 200 len: 1263 microversion: 2.1 time: 0.090191 Dec 24 10:47:20.119492 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 199/415] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:47:20 2021] GET /compute/v2.1/servers/12183d8e-4c50-449a-a93d-cee72f597b3d => generated 1263 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:47:20.233930 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-0fc6cb70-6737-4612-a331-e9225d52b26b tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:47:20.234628 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-0fc6cb70-6737-4612-a331-e9225d52b26b tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] [instance: a99a6a98-4010-4f8e-a83f-fcc490f6ece0] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:47:20.242282 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-0fc6cb70-6737-4612-a331-e9225d52b26b tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:20.242728 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-0fc6cb70-6737-4612-a331-e9225d52b26b tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:20.243548 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-0fc6cb70-6737-4612-a331-e9225d52b26b tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:20.243992 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-0fc6cb70-6737-4612-a331-e9225d52b26b tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:20.385224 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-0fc6cb70-6737-4612-a331-e9225d52b26b tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:47:20.393421 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-0fc6cb70-6737-4612-a331-e9225d52b26b tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:47:20.394909 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-0fc6cb70-6737-4612-a331-e9225d52b26b tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:47:20.396031 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-0fc6cb70-6737-4612-a331-e9225d52b26b tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] 10.222.0.30 "GET /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0" status: 200 len: 1723 microversion: 2.20 time: 0.166131 Dec 24 10:47:20.397062 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 217/416] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Dec 24 10:47:20 2021] GET /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0 => generated 1723 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 10:47:20.577394 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-e3e87b7d-b7fd-4467-a50c-c58b33040002 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:47:20.577999 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-e3e87b7d-b7fd-4467-a50c-c58b33040002 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] [instance: d0f3b23d-c8c0-4e9a-a625-299c00fb2e27] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:47:20.584966 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-e3e87b7d-b7fd-4467-a50c-c58b33040002 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:20.585412 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-e3e87b7d-b7fd-4467-a50c-c58b33040002 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:20.586186 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-e3e87b7d-b7fd-4467-a50c-c58b33040002 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:20.586645 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-e3e87b7d-b7fd-4467-a50c-c58b33040002 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:20.720222 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-e3e87b7d-b7fd-4467-a50c-c58b33040002 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ad5096717dc425c849dfe95ea55a6af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62d11172cdf4959a15ac1ffc5601aca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:47:20.727446 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-e3e87b7d-b7fd-4467-a50c-c58b33040002 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] 10.222.0.30 "GET /compute/v2.1/servers/d0f3b23d-c8c0-4e9a-a625-299c00fb2e27" status: 200 len: 1317 microversion: 2.1 time: 0.153674 Dec 24 10:47:20.728031 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 200/417] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:47:20 2021] GET /compute/v2.1/servers/d0f3b23d-c8c0-4e9a-a625-299c00fb2e27 => generated 1317 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 24 10:47:21.009147 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-11195eec-da4b-4bca-9082-c490d26a577c tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:47:21.010023 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-11195eec-da4b-4bca-9082-c490d26a577c tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] [instance: 9330dbb8-edad-4d54-afeb-8badc464250d] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:47:21.016337 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-11195eec-da4b-4bca-9082-c490d26a577c tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:21.016773 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-11195eec-da4b-4bca-9082-c490d26a577c tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:21.017554 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-11195eec-da4b-4bca-9082-c490d26a577c tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:21.017980 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-11195eec-da4b-4bca-9082-c490d26a577c tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:21.136996 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-bc216df2-64bc-4083-a4f4-1ebe9d977a85 tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:47:21.137605 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-bc216df2-64bc-4083-a4f4-1ebe9d977a85 tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] [instance: 12183d8e-4c50-449a-a93d-cee72f597b3d] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:47:21.148060 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-bc216df2-64bc-4083-a4f4-1ebe9d977a85 tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:21.148060 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-bc216df2-64bc-4083-a4f4-1ebe9d977a85 tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:21.148060 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-bc216df2-64bc-4083-a4f4-1ebe9d977a85 tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:21.148060 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-bc216df2-64bc-4083-a4f4-1ebe9d977a85 tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:21.207834 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-bc216df2-64bc-4083-a4f4-1ebe9d977a85 tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e2194bc8c0d44b186956c1b38a0c04a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed29a38d2fe424398ac10e585a980df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:47:21.214866 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-bc216df2-64bc-4083-a4f4-1ebe9d977a85 tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] 10.222.0.30 "GET /compute/v2.1/servers/12183d8e-4c50-449a-a93d-cee72f597b3d" status: 200 len: 1311 microversion: 2.1 time: 0.082368 Dec 24 10:47:21.215436 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 201/418] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:47:21 2021] GET /compute/v2.1/servers/12183d8e-4c50-449a-a93d-cee72f597b3d => generated 1311 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 24 10:47:21.219667 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-86b3da74-f21a-4f66-814c-19351b8a8afc tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:47:21.220260 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-86b3da74-f21a-4f66-814c-19351b8a8afc tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] [instance: 54d2f913-8385-4f34-8cb0-8c0f08c7a30f] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:47:21.226470 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-86b3da74-f21a-4f66-814c-19351b8a8afc tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:21.226917 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-86b3da74-f21a-4f66-814c-19351b8a8afc tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:21.227697 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-86b3da74-f21a-4f66-814c-19351b8a8afc tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:21.228128 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-86b3da74-f21a-4f66-814c-19351b8a8afc tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:21.356798 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-86b3da74-f21a-4f66-814c-19351b8a8afc tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d627b760f74f48ac560e2ce2e74e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '378bb44ad89440e49f7e290a5d31004e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:47:21.364856 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-86b3da74-f21a-4f66-814c-19351b8a8afc tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] 10.222.0.30 "GET /compute/v2.1/servers/54d2f913-8385-4f34-8cb0-8c0f08c7a30f" status: 200 len: 1516 microversion: 2.1 time: 0.148422 Dec 24 10:47:21.365582 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 202/419] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:47:21 2021] GET /compute/v2.1/servers/54d2f913-8385-4f34-8cb0-8c0f08c7a30f => generated 1516 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:47:21.380565 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-c28874fa-d739-4ba2-a5cc-a45869b32d9f tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "47d2c387-7cc5-45d8-a04a-55cd890ed581"}} {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:47:21.381704 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-c28874fa-d739-4ba2-a5cc-a45869b32d9f tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] [instance: 54d2f913-8385-4f34-8cb0-8c0f08c7a30f] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:47:21.387544 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-c28874fa-d739-4ba2-a5cc-a45869b32d9f tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:21.387992 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-c28874fa-d739-4ba2-a5cc-a45869b32d9f tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:21.388770 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-c28874fa-d739-4ba2-a5cc-a45869b32d9f tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:21.389237 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-c28874fa-d739-4ba2-a5cc-a45869b32d9f tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:23.929777 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-11195eec-da4b-4bca-9082-c490d26a577c tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] 10.222.0.30 "POST /compute/v2.1/servers/9330dbb8-edad-4d54-afeb-8badc464250d/action" status: 200 len: 27585 microversion: 2.1 time: 2.924292 Dec 24 10:47:23.930824 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 218/420] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Dec 24 10:47:21 2021] POST /compute/v2.1/servers/9330dbb8-edad-4d54-afeb-8badc464250d/action => generated 27585 bytes in 2926 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 24 10:47:23.935758 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-5e706d5f-28aa-4e86-a1d2-e55fcab7d560 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:47:23.936427 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-5e706d5f-28aa-4e86-a1d2-e55fcab7d560 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] [instance: a99a6a98-4010-4f8e-a83f-fcc490f6ece0] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:47:23.943964 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-5e706d5f-28aa-4e86-a1d2-e55fcab7d560 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:23.944401 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-5e706d5f-28aa-4e86-a1d2-e55fcab7d560 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:23.945208 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-5e706d5f-28aa-4e86-a1d2-e55fcab7d560 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:23.945639 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-5e706d5f-28aa-4e86-a1d2-e55fcab7d560 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:24.080497 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-5e706d5f-28aa-4e86-a1d2-e55fcab7d560 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:47:24.088942 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-5e706d5f-28aa-4e86-a1d2-e55fcab7d560 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:47:24.090463 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-5e706d5f-28aa-4e86-a1d2-e55fcab7d560 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:47:24.091607 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-5e706d5f-28aa-4e86-a1d2-e55fcab7d560 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] 10.222.0.30 "GET /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0" status: 200 len: 1723 microversion: 2.20 time: 0.159661 Dec 24 10:47:24.092164 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 219/421] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Dec 24 10:47:23 2021] GET /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0 => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 10:47:24.096248 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-c74200ff-3fbc-42ab-aa04-22713af3cd56 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:47:24.097250 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-c74200ff-3fbc-42ab-aa04-22713af3cd56 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] [instance: d0f3b23d-c8c0-4e9a-a625-299c00fb2e27] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:47:24.102726 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-c74200ff-3fbc-42ab-aa04-22713af3cd56 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:24.103171 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-c74200ff-3fbc-42ab-aa04-22713af3cd56 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:24.103965 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-c74200ff-3fbc-42ab-aa04-22713af3cd56 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:24.104397 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-c74200ff-3fbc-42ab-aa04-22713af3cd56 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:24.233428 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-c74200ff-3fbc-42ab-aa04-22713af3cd56 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ad5096717dc425c849dfe95ea55a6af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62d11172cdf4959a15ac1ffc5601aca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:47:24.242177 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-c74200ff-3fbc-42ab-aa04-22713af3cd56 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] 10.222.0.30 "GET /compute/v2.1/servers/d0f3b23d-c8c0-4e9a-a625-299c00fb2e27" status: 200 len: 1317 microversion: 2.1 time: 0.149080 Dec 24 10:47:24.242739 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 220/422] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:47:24 2021] GET /compute/v2.1/servers/d0f3b23d-c8c0-4e9a-a625-299c00fb2e27 => generated 1317 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:47:24.246857 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-f6e3d71e-d0a7-4f29-8fb5-659e0f23b7da tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:47:24.247448 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-f6e3d71e-d0a7-4f29-8fb5-659e0f23b7da tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] [instance: 12183d8e-4c50-449a-a93d-cee72f597b3d] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:47:24.253071 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-f6e3d71e-d0a7-4f29-8fb5-659e0f23b7da tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:24.253516 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-f6e3d71e-d0a7-4f29-8fb5-659e0f23b7da tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:24.254321 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-f6e3d71e-d0a7-4f29-8fb5-659e0f23b7da tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:24.254750 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-f6e3d71e-d0a7-4f29-8fb5-659e0f23b7da tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:24.314497 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-f6e3d71e-d0a7-4f29-8fb5-659e0f23b7da tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e2194bc8c0d44b186956c1b38a0c04a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed29a38d2fe424398ac10e585a980df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:47:24.325233 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-f6e3d71e-d0a7-4f29-8fb5-659e0f23b7da tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] 10.222.0.30 "GET /compute/v2.1/servers/12183d8e-4c50-449a-a93d-cee72f597b3d" status: 200 len: 1311 microversion: 2.1 time: 0.081488 Dec 24 10:47:24.325800 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 221/423] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:47:24 2021] GET /compute/v2.1/servers/12183d8e-4c50-449a-a93d-cee72f597b3d => generated 1311 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:47:24.923174 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-c28874fa-d739-4ba2-a5cc-a45869b32d9f tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] 10.222.0.30 "POST /compute/v2.1/servers/54d2f913-8385-4f34-8cb0-8c0f08c7a30f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.545823 Dec 24 10:47:24.925403 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 203/424] 10.222.0.30 () {60 vars in 1322 bytes} [Fri Dec 24 10:47:21 2021] POST /compute/v2.1/servers/54d2f913-8385-4f34-8cb0-8c0f08c7a30f/os-volume_attachments => generated 194 bytes in 3549 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 24 10:47:24.941412 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-0881d7ea-31b6-41aa-ab27-0c7df3e681d1 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:47:24.942151 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-0881d7ea-31b6-41aa-ab27-0c7df3e681d1 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] [instance: 9330dbb8-edad-4d54-afeb-8badc464250d] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:47:24.948735 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-0881d7ea-31b6-41aa-ab27-0c7df3e681d1 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:24.949410 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-0881d7ea-31b6-41aa-ab27-0c7df3e681d1 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:24.950354 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-0881d7ea-31b6-41aa-ab27-0c7df3e681d1 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:24.950974 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-0881d7ea-31b6-41aa-ab27-0c7df3e681d1 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:25.057854 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-0881d7ea-31b6-41aa-ab27-0c7df3e681d1 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] 10.222.0.30 "POST /compute/v2.1/servers/9330dbb8-edad-4d54-afeb-8badc464250d/action" status: 200 len: 28142 microversion: 2.1 time: 0.120606 Dec 24 10:47:25.058504 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 222/425] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Dec 24 10:47:24 2021] POST /compute/v2.1/servers/9330dbb8-edad-4d54-afeb-8badc464250d/action => generated 28142 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 24 10:47:25.110448 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-5522c036-a73a-463b-9169-1d6eae22eb66 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:47:25.111372 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-5522c036-a73a-463b-9169-1d6eae22eb66 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] [instance: a99a6a98-4010-4f8e-a83f-fcc490f6ece0] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:47:25.136441 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-5522c036-a73a-463b-9169-1d6eae22eb66 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:25.137162 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-5522c036-a73a-463b-9169-1d6eae22eb66 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:25.140281 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-5522c036-a73a-463b-9169-1d6eae22eb66 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:25.142219 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-5522c036-a73a-463b-9169-1d6eae22eb66 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:25.261899 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-c54fd95b-382f-47a5-8310-0d4dceaa0824 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:47:25.265903 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-c54fd95b-382f-47a5-8310-0d4dceaa0824 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] [instance: d0f3b23d-c8c0-4e9a-a625-299c00fb2e27] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:47:25.282287 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-c54fd95b-382f-47a5-8310-0d4dceaa0824 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:25.283340 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-c54fd95b-382f-47a5-8310-0d4dceaa0824 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:25.288041 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-c54fd95b-382f-47a5-8310-0d4dceaa0824 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:25.289985 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-c54fd95b-382f-47a5-8310-0d4dceaa0824 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:25.565647 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-c54fd95b-382f-47a5-8310-0d4dceaa0824 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ad5096717dc425c849dfe95ea55a6af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62d11172cdf4959a15ac1ffc5601aca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:47:25.575722 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-c54fd95b-382f-47a5-8310-0d4dceaa0824 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] 10.222.0.30 "GET /compute/v2.1/servers/d0f3b23d-c8c0-4e9a-a625-299c00fb2e27" status: 200 len: 1317 microversion: 2.1 time: 0.320037 Dec 24 10:47:25.576670 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 223/426] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:47:25 2021] GET /compute/v2.1/servers/d0f3b23d-c8c0-4e9a-a625-299c00fb2e27 => generated 1317 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:47:25.581851 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-5cd966b2-ae04-41a7-b8c7-5385be1d1139 tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:47:25.582788 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-5cd966b2-ae04-41a7-b8c7-5385be1d1139 tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] [instance: 12183d8e-4c50-449a-a93d-cee72f597b3d] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:47:25.589521 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-5cd966b2-ae04-41a7-b8c7-5385be1d1139 tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:25.590223 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-5cd966b2-ae04-41a7-b8c7-5385be1d1139 tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:25.592159 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-5cd966b2-ae04-41a7-b8c7-5385be1d1139 tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:25.592983 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-5cd966b2-ae04-41a7-b8c7-5385be1d1139 tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:25.597128 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-5522c036-a73a-463b-9169-1d6eae22eb66 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:47:25.622532 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-5522c036-a73a-463b-9169-1d6eae22eb66 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:47:25.626201 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-5522c036-a73a-463b-9169-1d6eae22eb66 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:47:25.631713 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-5522c036-a73a-463b-9169-1d6eae22eb66 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] 10.222.0.30 "GET /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0" status: 200 len: 1723 microversion: 2.20 time: 0.526026 Dec 24 10:47:25.632341 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 204/427] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Dec 24 10:47:25 2021] GET /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0 => generated 1723 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 10:47:25.848201 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-5cd966b2-ae04-41a7-b8c7-5385be1d1139 tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e2194bc8c0d44b186956c1b38a0c04a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed29a38d2fe424398ac10e585a980df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:47:25.860442 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-5cd966b2-ae04-41a7-b8c7-5385be1d1139 tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] 10.222.0.30 "GET /compute/v2.1/servers/12183d8e-4c50-449a-a93d-cee72f597b3d" status: 200 len: 1359 microversion: 2.1 time: 0.282602 Dec 24 10:47:25.861911 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 224/428] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:47:25 2021] GET /compute/v2.1/servers/12183d8e-4c50-449a-a93d-cee72f597b3d => generated 1359 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:47:26.073935 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-c8a78cb8-5fb1-4694-afc1-fc4320e6f8be tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:47:26.075733 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-c8a78cb8-5fb1-4694-afc1-fc4320e6f8be tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] [instance: 9330dbb8-edad-4d54-afeb-8badc464250d] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:47:26.091792 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-c8a78cb8-5fb1-4694-afc1-fc4320e6f8be tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:26.113559 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-c8a78cb8-5fb1-4694-afc1-fc4320e6f8be tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:26.114566 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-c8a78cb8-5fb1-4694-afc1-fc4320e6f8be tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:26.115237 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-c8a78cb8-5fb1-4694-afc1-fc4320e6f8be tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:26.336402 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-c8a78cb8-5fb1-4694-afc1-fc4320e6f8be tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] 10.222.0.30 "POST /compute/v2.1/servers/9330dbb8-edad-4d54-afeb-8badc464250d/action" status: 200 len: 28142 microversion: 2.1 time: 0.268139 Dec 24 10:47:26.338661 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 205/429] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Dec 24 10:47:26 2021] POST /compute/v2.1/servers/9330dbb8-edad-4d54-afeb-8badc464250d/action => generated 28142 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 24 10:47:26.596039 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-eb00ef89-8e43-458d-86fe-2e0c41926fe1 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:47:26.598235 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-eb00ef89-8e43-458d-86fe-2e0c41926fe1 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] [instance: d0f3b23d-c8c0-4e9a-a625-299c00fb2e27] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:47:26.605911 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-eb00ef89-8e43-458d-86fe-2e0c41926fe1 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:26.613778 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-eb00ef89-8e43-458d-86fe-2e0c41926fe1 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:26.615704 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-eb00ef89-8e43-458d-86fe-2e0c41926fe1 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:26.619457 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-eb00ef89-8e43-458d-86fe-2e0c41926fe1 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:26.652270 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-ff8e3279-53da-4f11-bf77-8313c7306252 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:47:26.653114 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-ff8e3279-53da-4f11-bf77-8313c7306252 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] [instance: a99a6a98-4010-4f8e-a83f-fcc490f6ece0] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:47:26.664535 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-ff8e3279-53da-4f11-bf77-8313c7306252 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:26.665737 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-ff8e3279-53da-4f11-bf77-8313c7306252 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:26.668706 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-ff8e3279-53da-4f11-bf77-8313c7306252 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:26.669417 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-ff8e3279-53da-4f11-bf77-8313c7306252 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:26.909743 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-eb00ef89-8e43-458d-86fe-2e0c41926fe1 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ad5096717dc425c849dfe95ea55a6af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62d11172cdf4959a15ac1ffc5601aca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:47:26.924248 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-eb00ef89-8e43-458d-86fe-2e0c41926fe1 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] 10.222.0.30 "GET /compute/v2.1/servers/d0f3b23d-c8c0-4e9a-a625-299c00fb2e27" status: 200 len: 1317 microversion: 2.1 time: 0.333512 Dec 24 10:47:26.926612 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 225/430] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:47:26 2021] GET /compute/v2.1/servers/d0f3b23d-c8c0-4e9a-a625-299c00fb2e27 => generated 1317 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:47:26.933077 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-e3b2b3bd-7304-4789-8a93-85fbb8da1736 tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:47:26.934537 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-e3b2b3bd-7304-4789-8a93-85fbb8da1736 tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] [instance: 12183d8e-4c50-449a-a93d-cee72f597b3d] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:47:26.943223 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-e3b2b3bd-7304-4789-8a93-85fbb8da1736 tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:26.945022 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-e3b2b3bd-7304-4789-8a93-85fbb8da1736 tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:26.947084 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-e3b2b3bd-7304-4789-8a93-85fbb8da1736 tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:26.947714 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-e3b2b3bd-7304-4789-8a93-85fbb8da1736 tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:27.050530 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-ff8e3279-53da-4f11-bf77-8313c7306252 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:47:27.069391 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-ff8e3279-53da-4f11-bf77-8313c7306252 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:47:27.076542 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-ff8e3279-53da-4f11-bf77-8313c7306252 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:47:27.083105 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-ff8e3279-53da-4f11-bf77-8313c7306252 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] 10.222.0.30 "GET /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0" status: 200 len: 1723 microversion: 2.20 time: 0.433370 Dec 24 10:47:27.095727 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 206/431] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Dec 24 10:47:26 2021] GET /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0 => generated 1723 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 10:47:27.265112 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-e3b2b3bd-7304-4789-8a93-85fbb8da1736 tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e2194bc8c0d44b186956c1b38a0c04a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed29a38d2fe424398ac10e585a980df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:47:27.286443 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-e3b2b3bd-7304-4789-8a93-85fbb8da1736 tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] 10.222.0.30 "GET /compute/v2.1/servers/12183d8e-4c50-449a-a93d-cee72f597b3d" status: 200 len: 1359 microversion: 2.1 time: 0.358392 Dec 24 10:47:27.289292 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 226/432] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:47:26 2021] GET /compute/v2.1/servers/12183d8e-4c50-449a-a93d-cee72f597b3d => generated 1359 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:47:27.351044 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-e214302d-4adc-4b7a-887d-95def8059475 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:47:27.352219 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-e214302d-4adc-4b7a-887d-95def8059475 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] [instance: 9330dbb8-edad-4d54-afeb-8badc464250d] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:47:27.354934 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [req-4457350f-670f-451b-9613-60b1d8c531f8 req-b15cb0aa-2a8f-4e96-a927-f4ef714a634b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "12183d8e-4c50-449a-a93d-cee72f597b3d", "tag": "abebf56e-a643-48ae-a779-897dbd105170"}]} {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:47:27.363497 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-e214302d-4adc-4b7a-887d-95def8059475 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:27.368050 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 10:47:27.368050 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: warnings.warn(msg) Dec 24 10:47:27.368957 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-e214302d-4adc-4b7a-887d-95def8059475 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:27.370100 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-e214302d-4adc-4b7a-887d-95def8059475 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:27.370708 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-e214302d-4adc-4b7a-887d-95def8059475 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:27.395419 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [req-4457350f-670f-451b-9613-60b1d8c531f8 req-b15cb0aa-2a8f-4e96-a927-f4ef714a634b service nova] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:27.395896 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [req-4457350f-670f-451b-9613-60b1d8c531f8 req-b15cb0aa-2a8f-4e96-a927-f4ef714a634b service nova] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:27.428746 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.compute.server_external_events [req-4457350f-670f-451b-9613-60b1d8c531f8 req-b15cb0aa-2a8f-4e96-a927-f4ef714a634b service nova] Creating event network-changed:abebf56e-a643-48ae-a779-897dbd105170 for instance 12183d8e-4c50-449a-a93d-cee72f597b3d on hv-cinder-81644 Dec 24 10:47:27.442918 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [req-4457350f-670f-451b-9613-60b1d8c531f8 req-b15cb0aa-2a8f-4e96-a927-f4ef714a634b service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104174 Dec 24 10:47:27.445132 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 207/433] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Dec 24 10:47:27 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 10:47:27.943162 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-8e036109-3abc-4ccc-8f2b-be42dee9d748 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:47:27.944015 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-8e036109-3abc-4ccc-8f2b-be42dee9d748 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] [instance: d0f3b23d-c8c0-4e9a-a625-299c00fb2e27] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:47:27.958035 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-8e036109-3abc-4ccc-8f2b-be42dee9d748 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:27.958629 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-8e036109-3abc-4ccc-8f2b-be42dee9d748 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:27.959542 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-8e036109-3abc-4ccc-8f2b-be42dee9d748 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:27.960083 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-8e036109-3abc-4ccc-8f2b-be42dee9d748 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:28.131587 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-8e036109-3abc-4ccc-8f2b-be42dee9d748 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ad5096717dc425c849dfe95ea55a6af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62d11172cdf4959a15ac1ffc5601aca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:47:28.139395 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-8e036109-3abc-4ccc-8f2b-be42dee9d748 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] 10.222.0.30 "GET /compute/v2.1/servers/d0f3b23d-c8c0-4e9a-a625-299c00fb2e27" status: 200 len: 1317 microversion: 2.1 time: 0.201055 Dec 24 10:47:28.150458 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 208/434] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:47:27 2021] GET /compute/v2.1/servers/d0f3b23d-c8c0-4e9a-a625-299c00fb2e27 => generated 1317 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 24 10:47:28.155705 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-d409edf6-1213-48e4-8299-4808d8d01459 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:47:28.156466 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-d409edf6-1213-48e4-8299-4808d8d01459 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] [instance: a99a6a98-4010-4f8e-a83f-fcc490f6ece0] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:47:28.164523 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-d409edf6-1213-48e4-8299-4808d8d01459 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:28.165322 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-d409edf6-1213-48e4-8299-4808d8d01459 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:28.167057 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-d409edf6-1213-48e4-8299-4808d8d01459 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:28.167818 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-d409edf6-1213-48e4-8299-4808d8d01459 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:28.332487 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-d409edf6-1213-48e4-8299-4808d8d01459 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:47:28.357119 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-d409edf6-1213-48e4-8299-4808d8d01459 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:47:28.357119 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-d409edf6-1213-48e4-8299-4808d8d01459 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:47:28.357119 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-d409edf6-1213-48e4-8299-4808d8d01459 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] 10.222.0.30 "GET /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0" status: 200 len: 1723 microversion: 2.20 time: 0.197122 Dec 24 10:47:28.357433 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 209/435] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Dec 24 10:47:28 2021] GET /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0 => generated 1723 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 10:47:28.357433 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-ded7b34c-063b-49b9-a804-66e417527071 tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:47:28.357433 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-ded7b34c-063b-49b9-a804-66e417527071 tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] [instance: 12183d8e-4c50-449a-a93d-cee72f597b3d] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:47:28.361551 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-ded7b34c-063b-49b9-a804-66e417527071 tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:28.362618 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-ded7b34c-063b-49b9-a804-66e417527071 tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:28.363413 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-ded7b34c-063b-49b9-a804-66e417527071 tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:28.363847 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-ded7b34c-063b-49b9-a804-66e417527071 tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:28.513248 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-ded7b34c-063b-49b9-a804-66e417527071 tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e2194bc8c0d44b186956c1b38a0c04a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed29a38d2fe424398ac10e585a980df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:47:28.520807 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-ded7b34c-063b-49b9-a804-66e417527071 tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] 10.222.0.30 "GET /compute/v2.1/servers/12183d8e-4c50-449a-a93d-cee72f597b3d" status: 200 len: 1359 microversion: 2.1 time: 0.170220 Dec 24 10:47:28.521652 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 210/436] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:47:28 2021] GET /compute/v2.1/servers/12183d8e-4c50-449a-a93d-cee72f597b3d => generated 1359 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:47:29.157781 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-bf2d6479-842f-4705-9188-62d39f29367f tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:47:29.158426 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-bf2d6479-842f-4705-9188-62d39f29367f tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] [instance: d0f3b23d-c8c0-4e9a-a625-299c00fb2e27] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:47:29.165135 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-bf2d6479-842f-4705-9188-62d39f29367f tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:29.165573 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-bf2d6479-842f-4705-9188-62d39f29367f tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:29.166354 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-bf2d6479-842f-4705-9188-62d39f29367f tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:29.166902 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-bf2d6479-842f-4705-9188-62d39f29367f tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:29.314717 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-bf2d6479-842f-4705-9188-62d39f29367f tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ad5096717dc425c849dfe95ea55a6af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62d11172cdf4959a15ac1ffc5601aca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:47:29.322489 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-bf2d6479-842f-4705-9188-62d39f29367f tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] 10.222.0.30 "GET /compute/v2.1/servers/d0f3b23d-c8c0-4e9a-a625-299c00fb2e27" status: 200 len: 1317 microversion: 2.1 time: 0.168223 Dec 24 10:47:29.322928 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 211/437] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:47:29 2021] GET /compute/v2.1/servers/d0f3b23d-c8c0-4e9a-a625-299c00fb2e27 => generated 1317 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:47:29.336366 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [req-5d0db7b0-f263-453e-86a4-20a0e9f0da45 req-28d249f2-c5bb-45db-acb1-937082cc6771 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0f3b23d-c8c0-4e9a-a625-299c00fb2e27", "name": "network-vif-plugged", "status": "completed", "tag": "4fde9d66-dead-4e85-8d7f-9dffb8700f99"}]} {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:47:29.338262 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 10:47:29.338262 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: warnings.warn(msg) Dec 24 10:47:29.350305 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [req-5d0db7b0-f263-453e-86a4-20a0e9f0da45 req-28d249f2-c5bb-45db-acb1-937082cc6771 service nova] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:29.350745 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [req-5d0db7b0-f263-453e-86a4-20a0e9f0da45 req-28d249f2-c5bb-45db-acb1-937082cc6771 service nova] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:29.361961 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.compute.server_external_events [req-5d0db7b0-f263-453e-86a4-20a0e9f0da45 req-28d249f2-c5bb-45db-acb1-937082cc6771 service nova] Creating event network-vif-plugged:4fde9d66-dead-4e85-8d7f-9dffb8700f99 for instance d0f3b23d-c8c0-4e9a-a625-299c00fb2e27 on hv-cinder-81644 Dec 24 10:47:29.367767 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [req-5d0db7b0-f263-453e-86a4-20a0e9f0da45 req-28d249f2-c5bb-45db-acb1-937082cc6771 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043629 Dec 24 10:47:29.368340 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 212/438] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Dec 24 10:47:29 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 10:47:29.373649 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-51a7d466-c347-47da-8800-bead9a3f8160 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:47:29.374338 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-51a7d466-c347-47da-8800-bead9a3f8160 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] [instance: a99a6a98-4010-4f8e-a83f-fcc490f6ece0] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:47:29.380684 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-51a7d466-c347-47da-8800-bead9a3f8160 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:29.381165 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-51a7d466-c347-47da-8800-bead9a3f8160 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:29.382124 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-51a7d466-c347-47da-8800-bead9a3f8160 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:29.382556 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-51a7d466-c347-47da-8800-bead9a3f8160 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:29.572057 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-51a7d466-c347-47da-8800-bead9a3f8160 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:47:29.579816 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-51a7d466-c347-47da-8800-bead9a3f8160 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:47:29.582025 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-51a7d466-c347-47da-8800-bead9a3f8160 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:47:29.583176 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-51a7d466-c347-47da-8800-bead9a3f8160 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] 10.222.0.30 "GET /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0" status: 200 len: 1723 microversion: 2.20 time: 0.213556 Dec 24 10:47:29.583746 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 213/439] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Dec 24 10:47:29 2021] GET /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0 => generated 1723 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 10:47:29.588274 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-ca074c7a-59ed-400a-b166-84130eb0ccb6 tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:47:29.588983 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-ca074c7a-59ed-400a-b166-84130eb0ccb6 tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] [instance: 12183d8e-4c50-449a-a93d-cee72f597b3d] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:47:29.595476 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-ca074c7a-59ed-400a-b166-84130eb0ccb6 tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:29.595946 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-ca074c7a-59ed-400a-b166-84130eb0ccb6 tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:29.596855 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-ca074c7a-59ed-400a-b166-84130eb0ccb6 tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:29.597308 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-ca074c7a-59ed-400a-b166-84130eb0ccb6 tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:29.912070 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-ca074c7a-59ed-400a-b166-84130eb0ccb6 tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e2194bc8c0d44b186956c1b38a0c04a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed29a38d2fe424398ac10e585a980df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:47:29.912070 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-ca074c7a-59ed-400a-b166-84130eb0ccb6 tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] 10.222.0.30 "GET /compute/v2.1/servers/12183d8e-4c50-449a-a93d-cee72f597b3d" status: 200 len: 1359 microversion: 2.1 time: 0.152158 Dec 24 10:47:29.912070 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 214/440] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:47:29 2021] GET /compute/v2.1/servers/12183d8e-4c50-449a-a93d-cee72f597b3d => generated 1359 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:47:30.339375 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-6e1fab28-88cf-456a-bb99-11cb4fafb58f tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:47:30.340045 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-6e1fab28-88cf-456a-bb99-11cb4fafb58f tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] [instance: d0f3b23d-c8c0-4e9a-a625-299c00fb2e27] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:47:30.346750 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-6e1fab28-88cf-456a-bb99-11cb4fafb58f tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:30.347193 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-6e1fab28-88cf-456a-bb99-11cb4fafb58f tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:30.347971 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-6e1fab28-88cf-456a-bb99-11cb4fafb58f tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:30.348402 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-6e1fab28-88cf-456a-bb99-11cb4fafb58f tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:30.517376 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-6e1fab28-88cf-456a-bb99-11cb4fafb58f tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ad5096717dc425c849dfe95ea55a6af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62d11172cdf4959a15ac1ffc5601aca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:47:30.525743 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-6e1fab28-88cf-456a-bb99-11cb4fafb58f tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] 10.222.0.30 "GET /compute/v2.1/servers/d0f3b23d-c8c0-4e9a-a625-299c00fb2e27" status: 200 len: 1317 microversion: 2.1 time: 0.189438 Dec 24 10:47:30.526636 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 215/441] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:47:30 2021] GET /compute/v2.1/servers/d0f3b23d-c8c0-4e9a-a625-299c00fb2e27 => generated 1317 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 24 10:47:30.602512 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-28ead51d-7125-4e33-ab95-5509ccc23db8 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:47:30.603050 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-28ead51d-7125-4e33-ab95-5509ccc23db8 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] [instance: a99a6a98-4010-4f8e-a83f-fcc490f6ece0] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:47:30.609594 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-28ead51d-7125-4e33-ab95-5509ccc23db8 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:30.610041 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-28ead51d-7125-4e33-ab95-5509ccc23db8 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:30.610937 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-28ead51d-7125-4e33-ab95-5509ccc23db8 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:30.611376 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-28ead51d-7125-4e33-ab95-5509ccc23db8 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:30.772334 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-28ead51d-7125-4e33-ab95-5509ccc23db8 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:47:30.780967 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-28ead51d-7125-4e33-ab95-5509ccc23db8 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:47:30.782805 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-28ead51d-7125-4e33-ab95-5509ccc23db8 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:47:30.784277 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-28ead51d-7125-4e33-ab95-5509ccc23db8 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] 10.222.0.30 "GET /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0" status: 200 len: 1723 microversion: 2.20 time: 0.185627 Dec 24 10:47:30.785366 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 216/442] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Dec 24 10:47:30 2021] GET /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0 => generated 1723 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 24 10:47:30.920744 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-12599729-a2b2-4bfb-aa83-923ad8bdf79e tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:47:30.922019 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-12599729-a2b2-4bfb-aa83-923ad8bdf79e tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] [instance: 12183d8e-4c50-449a-a93d-cee72f597b3d] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:47:30.929115 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-12599729-a2b2-4bfb-aa83-923ad8bdf79e tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:30.929563 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-12599729-a2b2-4bfb-aa83-923ad8bdf79e tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:30.930351 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-12599729-a2b2-4bfb-aa83-923ad8bdf79e tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:30.930780 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-12599729-a2b2-4bfb-aa83-923ad8bdf79e tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:31.066144 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-12599729-a2b2-4bfb-aa83-923ad8bdf79e tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e2194bc8c0d44b186956c1b38a0c04a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed29a38d2fe424398ac10e585a980df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:47:31.074019 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-12599729-a2b2-4bfb-aa83-923ad8bdf79e tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] 10.222.0.30 "GET /compute/v2.1/servers/12183d8e-4c50-449a-a93d-cee72f597b3d" status: 200 len: 1359 microversion: 2.1 time: 0.165866 Dec 24 10:47:31.077054 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 217/443] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:47:30 2021] GET /compute/v2.1/servers/12183d8e-4c50-449a-a93d-cee72f597b3d => generated 1359 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:47:31.541725 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-f2e948c3-416d-4019-a980-4b8fb8d3c163 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:47:31.542489 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-f2e948c3-416d-4019-a980-4b8fb8d3c163 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] [instance: d0f3b23d-c8c0-4e9a-a625-299c00fb2e27] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:47:31.553966 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-f2e948c3-416d-4019-a980-4b8fb8d3c163 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:31.554539 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-f2e948c3-416d-4019-a980-4b8fb8d3c163 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:31.555611 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-f2e948c3-416d-4019-a980-4b8fb8d3c163 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:31.556107 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-f2e948c3-416d-4019-a980-4b8fb8d3c163 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:31.718922 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-f2e948c3-416d-4019-a980-4b8fb8d3c163 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ad5096717dc425c849dfe95ea55a6af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62d11172cdf4959a15ac1ffc5601aca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:47:31.727400 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-f2e948c3-416d-4019-a980-4b8fb8d3c163 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] 10.222.0.30 "GET /compute/v2.1/servers/d0f3b23d-c8c0-4e9a-a625-299c00fb2e27" status: 200 len: 1317 microversion: 2.1 time: 0.189187 Dec 24 10:47:31.728497 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 218/444] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:47:31 2021] GET /compute/v2.1/servers/d0f3b23d-c8c0-4e9a-a625-299c00fb2e27 => generated 1317 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 24 10:47:31.803476 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-ab6bd375-b5ee-4044-b800-c412c93db8b1 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:47:31.804101 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-ab6bd375-b5ee-4044-b800-c412c93db8b1 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] [instance: a99a6a98-4010-4f8e-a83f-fcc490f6ece0] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:47:31.810159 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-ab6bd375-b5ee-4044-b800-c412c93db8b1 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:31.810619 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-ab6bd375-b5ee-4044-b800-c412c93db8b1 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:31.811357 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-ab6bd375-b5ee-4044-b800-c412c93db8b1 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:31.811953 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-ab6bd375-b5ee-4044-b800-c412c93db8b1 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:31.962825 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-ab6bd375-b5ee-4044-b800-c412c93db8b1 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:47:31.969320 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-ab6bd375-b5ee-4044-b800-c412c93db8b1 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:47:31.970940 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-ab6bd375-b5ee-4044-b800-c412c93db8b1 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:47:31.972265 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-ab6bd375-b5ee-4044-b800-c412c93db8b1 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] 10.222.0.30 "GET /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0" status: 200 len: 1723 microversion: 2.20 time: 0.173893 Dec 24 10:47:31.972937 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 219/445] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Dec 24 10:47:31 2021] GET /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0 => generated 1723 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 24 10:47:32.091758 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-bbff69d4-2b92-4c7a-b261-cbb5708480fb tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:47:32.093096 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-bbff69d4-2b92-4c7a-b261-cbb5708480fb tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] [instance: 12183d8e-4c50-449a-a93d-cee72f597b3d] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:47:32.102529 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-bbff69d4-2b92-4c7a-b261-cbb5708480fb tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:32.102529 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-bbff69d4-2b92-4c7a-b261-cbb5708480fb tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:32.102529 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-bbff69d4-2b92-4c7a-b261-cbb5708480fb tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:32.102529 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-bbff69d4-2b92-4c7a-b261-cbb5708480fb tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:32.282952 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-bbff69d4-2b92-4c7a-b261-cbb5708480fb tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e2194bc8c0d44b186956c1b38a0c04a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed29a38d2fe424398ac10e585a980df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:47:32.305257 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-bbff69d4-2b92-4c7a-b261-cbb5708480fb tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] 10.222.0.30 "GET /compute/v2.1/servers/12183d8e-4c50-449a-a93d-cee72f597b3d" status: 200 len: 1359 microversion: 2.1 time: 0.204960 Dec 24 10:47:32.315476 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 220/446] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:47:32 2021] GET /compute/v2.1/servers/12183d8e-4c50-449a-a93d-cee72f597b3d => generated 1359 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 24 10:47:32.744366 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-863000c0-c863-4a5d-809b-561e052acd26 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:47:32.745148 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-863000c0-c863-4a5d-809b-561e052acd26 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] [instance: d0f3b23d-c8c0-4e9a-a625-299c00fb2e27] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:47:32.751153 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-863000c0-c863-4a5d-809b-561e052acd26 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:32.751590 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-863000c0-c863-4a5d-809b-561e052acd26 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:32.752347 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-863000c0-c863-4a5d-809b-561e052acd26 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:32.752773 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-863000c0-c863-4a5d-809b-561e052acd26 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:32.901730 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-863000c0-c863-4a5d-809b-561e052acd26 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ad5096717dc425c849dfe95ea55a6af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62d11172cdf4959a15ac1ffc5601aca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:47:32.909656 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-863000c0-c863-4a5d-809b-561e052acd26 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] 10.222.0.30 "GET /compute/v2.1/servers/d0f3b23d-c8c0-4e9a-a625-299c00fb2e27" status: 200 len: 1317 microversion: 2.1 time: 0.168896 Dec 24 10:47:32.910221 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 221/447] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:47:32 2021] GET /compute/v2.1/servers/d0f3b23d-c8c0-4e9a-a625-299c00fb2e27 => generated 1317 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 24 10:47:32.990244 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-92d433c6-0ffc-4248-bad1-015a202760cd tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:47:32.990914 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-92d433c6-0ffc-4248-bad1-015a202760cd tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] [instance: a99a6a98-4010-4f8e-a83f-fcc490f6ece0] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:47:32.996853 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-92d433c6-0ffc-4248-bad1-015a202760cd tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:32.997411 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-92d433c6-0ffc-4248-bad1-015a202760cd tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:32.998782 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-92d433c6-0ffc-4248-bad1-015a202760cd tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:32.999214 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-92d433c6-0ffc-4248-bad1-015a202760cd tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:33.176456 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-92d433c6-0ffc-4248-bad1-015a202760cd tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:47:33.184640 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-92d433c6-0ffc-4248-bad1-015a202760cd tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:47:33.186162 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-92d433c6-0ffc-4248-bad1-015a202760cd tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:47:33.187328 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-92d433c6-0ffc-4248-bad1-015a202760cd tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] 10.222.0.30 "GET /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0" status: 200 len: 1723 microversion: 2.20 time: 0.201505 Dec 24 10:47:33.187886 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 222/448] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Dec 24 10:47:32 2021] GET /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0 => generated 1723 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 24 10:47:33.321709 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-4bbadcf0-ebb7-4927-8c30-e859732cebca tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:47:33.322372 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-4bbadcf0-ebb7-4927-8c30-e859732cebca tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] [instance: 12183d8e-4c50-449a-a93d-cee72f597b3d] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:47:33.328562 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-4bbadcf0-ebb7-4927-8c30-e859732cebca tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:33.329052 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-4bbadcf0-ebb7-4927-8c30-e859732cebca tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:33.329833 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-4bbadcf0-ebb7-4927-8c30-e859732cebca tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:33.330267 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-4bbadcf0-ebb7-4927-8c30-e859732cebca tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:33.465019 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-4bbadcf0-ebb7-4927-8c30-e859732cebca tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e2194bc8c0d44b186956c1b38a0c04a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed29a38d2fe424398ac10e585a980df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:47:33.473104 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-4bbadcf0-ebb7-4927-8c30-e859732cebca tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] 10.222.0.30 "GET /compute/v2.1/servers/12183d8e-4c50-449a-a93d-cee72f597b3d" status: 200 len: 1359 microversion: 2.1 time: 0.155130 Dec 24 10:47:33.473719 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 223/449] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:47:33 2021] GET /compute/v2.1/servers/12183d8e-4c50-449a-a93d-cee72f597b3d => generated 1359 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 24 10:47:33.927148 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-89953c4a-da26-4ad2-b3bc-ffeb748cca5a tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:47:33.927868 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-89953c4a-da26-4ad2-b3bc-ffeb748cca5a tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] [instance: d0f3b23d-c8c0-4e9a-a625-299c00fb2e27] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:47:33.950515 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-89953c4a-da26-4ad2-b3bc-ffeb748cca5a tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:33.951150 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-89953c4a-da26-4ad2-b3bc-ffeb748cca5a tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:33.952118 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-89953c4a-da26-4ad2-b3bc-ffeb748cca5a tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:33.952549 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-89953c4a-da26-4ad2-b3bc-ffeb748cca5a tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:34.139117 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-89953c4a-da26-4ad2-b3bc-ffeb748cca5a tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ad5096717dc425c849dfe95ea55a6af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62d11172cdf4959a15ac1ffc5601aca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:47:34.140528 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-89953c4a-da26-4ad2-b3bc-ffeb748cca5a tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] 10.222.0.30 "GET /compute/v2.1/servers/d0f3b23d-c8c0-4e9a-a625-299c00fb2e27" status: 200 len: 1317 microversion: 2.1 time: 0.217690 Dec 24 10:47:34.141660 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 224/450] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:47:33 2021] GET /compute/v2.1/servers/d0f3b23d-c8c0-4e9a-a625-299c00fb2e27 => generated 1317 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 24 10:47:34.206458 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-46b9d8f9-c557-4503-9c71-a2ec6a05ceba tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:47:34.207052 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-46b9d8f9-c557-4503-9c71-a2ec6a05ceba tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] [instance: a99a6a98-4010-4f8e-a83f-fcc490f6ece0] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:47:34.225180 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-46b9d8f9-c557-4503-9c71-a2ec6a05ceba tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:34.225180 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-46b9d8f9-c557-4503-9c71-a2ec6a05ceba tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:34.225180 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-46b9d8f9-c557-4503-9c71-a2ec6a05ceba tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:34.225180 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-46b9d8f9-c557-4503-9c71-a2ec6a05ceba tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:34.412298 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-46b9d8f9-c557-4503-9c71-a2ec6a05ceba tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:47:34.441838 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-46b9d8f9-c557-4503-9c71-a2ec6a05ceba tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:47:34.444061 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-46b9d8f9-c557-4503-9c71-a2ec6a05ceba tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:47:34.449719 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-46b9d8f9-c557-4503-9c71-a2ec6a05ceba tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] 10.222.0.30 "GET /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0" status: 200 len: 1723 microversion: 2.20 time: 0.247504 Dec 24 10:47:34.467945 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 225/451] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Dec 24 10:47:34 2021] GET /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0 => generated 1723 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 10:47:34.491038 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-af78882f-8941-4d28-bfa7-32ad48becc50 tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:47:34.491964 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-af78882f-8941-4d28-bfa7-32ad48becc50 tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] [instance: 12183d8e-4c50-449a-a93d-cee72f597b3d] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:47:34.509521 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-af78882f-8941-4d28-bfa7-32ad48becc50 tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:34.509521 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-af78882f-8941-4d28-bfa7-32ad48becc50 tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:34.509521 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-af78882f-8941-4d28-bfa7-32ad48becc50 tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:34.509521 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-af78882f-8941-4d28-bfa7-32ad48becc50 tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:34.690041 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-af78882f-8941-4d28-bfa7-32ad48becc50 tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e2194bc8c0d44b186956c1b38a0c04a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed29a38d2fe424398ac10e585a980df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:47:34.697716 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-af78882f-8941-4d28-bfa7-32ad48becc50 tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] 10.222.0.30 "GET /compute/v2.1/servers/12183d8e-4c50-449a-a93d-cee72f597b3d" status: 200 len: 1359 microversion: 2.1 time: 0.210957 Dec 24 10:47:34.701036 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 226/452] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:47:34 2021] GET /compute/v2.1/servers/12183d8e-4c50-449a-a93d-cee72f597b3d => generated 1359 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 24 10:47:35.156117 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-4642e7a1-021f-4ee9-8feb-8e7c1228cd79 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:47:35.156897 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-4642e7a1-021f-4ee9-8feb-8e7c1228cd79 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] [instance: d0f3b23d-c8c0-4e9a-a625-299c00fb2e27] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:47:35.164711 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-4642e7a1-021f-4ee9-8feb-8e7c1228cd79 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:35.165420 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-4642e7a1-021f-4ee9-8feb-8e7c1228cd79 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:35.166579 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-4642e7a1-021f-4ee9-8feb-8e7c1228cd79 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:35.167226 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-4642e7a1-021f-4ee9-8feb-8e7c1228cd79 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:35.371194 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-4642e7a1-021f-4ee9-8feb-8e7c1228cd79 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ad5096717dc425c849dfe95ea55a6af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62d11172cdf4959a15ac1ffc5601aca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:47:35.378379 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-4642e7a1-021f-4ee9-8feb-8e7c1228cd79 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] 10.222.0.30 "GET /compute/v2.1/servers/d0f3b23d-c8c0-4e9a-a625-299c00fb2e27" status: 200 len: 1317 microversion: 2.1 time: 0.225800 Dec 24 10:47:35.378943 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 227/453] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:47:35 2021] GET /compute/v2.1/servers/d0f3b23d-c8c0-4e9a-a625-299c00fb2e27 => generated 1317 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 24 10:47:35.470798 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-ad8b1b27-8a46-4b83-a0fd-86e588c1c617 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:47:35.471816 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-ad8b1b27-8a46-4b83-a0fd-86e588c1c617 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] [instance: a99a6a98-4010-4f8e-a83f-fcc490f6ece0] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:47:35.477921 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-ad8b1b27-8a46-4b83-a0fd-86e588c1c617 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:35.478361 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-ad8b1b27-8a46-4b83-a0fd-86e588c1c617 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:35.479146 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-ad8b1b27-8a46-4b83-a0fd-86e588c1c617 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:35.479573 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-ad8b1b27-8a46-4b83-a0fd-86e588c1c617 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:35.660365 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-ad8b1b27-8a46-4b83-a0fd-86e588c1c617 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:47:35.668451 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-ad8b1b27-8a46-4b83-a0fd-86e588c1c617 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:47:35.670300 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-ad8b1b27-8a46-4b83-a0fd-86e588c1c617 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:47:35.671674 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-ad8b1b27-8a46-4b83-a0fd-86e588c1c617 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] 10.222.0.30 "GET /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0" status: 200 len: 1723 microversion: 2.20 time: 0.204743 Dec 24 10:47:35.672228 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 228/454] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Dec 24 10:47:35 2021] GET /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0 => generated 1723 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 24 10:47:35.714156 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-515dd606-ce20-4ed3-9bb1-9be58ab934b0 tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:47:35.714906 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-515dd606-ce20-4ed3-9bb1-9be58ab934b0 tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] [instance: 12183d8e-4c50-449a-a93d-cee72f597b3d] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:47:35.721050 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-515dd606-ce20-4ed3-9bb1-9be58ab934b0 tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:35.721904 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-515dd606-ce20-4ed3-9bb1-9be58ab934b0 tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:35.722687 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-515dd606-ce20-4ed3-9bb1-9be58ab934b0 tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:35.723296 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-515dd606-ce20-4ed3-9bb1-9be58ab934b0 tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:35.930543 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-515dd606-ce20-4ed3-9bb1-9be58ab934b0 tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e2194bc8c0d44b186956c1b38a0c04a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed29a38d2fe424398ac10e585a980df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:47:35.939521 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-515dd606-ce20-4ed3-9bb1-9be58ab934b0 tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] 10.222.0.30 "GET /compute/v2.1/servers/12183d8e-4c50-449a-a93d-cee72f597b3d" status: 200 len: 1359 microversion: 2.1 time: 0.228738 Dec 24 10:47:35.940859 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 229/455] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:47:35 2021] GET /compute/v2.1/servers/12183d8e-4c50-449a-a93d-cee72f597b3d => generated 1359 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 24 10:47:36.395378 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-b2b6d927-38d3-4c47-8e81-8e21f9345817 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:47:36.396107 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-b2b6d927-38d3-4c47-8e81-8e21f9345817 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] [instance: d0f3b23d-c8c0-4e9a-a625-299c00fb2e27] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:47:36.405929 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-b2b6d927-38d3-4c47-8e81-8e21f9345817 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:36.406442 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-b2b6d927-38d3-4c47-8e81-8e21f9345817 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:36.409407 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-b2b6d927-38d3-4c47-8e81-8e21f9345817 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:36.410892 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-b2b6d927-38d3-4c47-8e81-8e21f9345817 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:36.630605 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-b2b6d927-38d3-4c47-8e81-8e21f9345817 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ad5096717dc425c849dfe95ea55a6af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62d11172cdf4959a15ac1ffc5601aca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:47:36.638396 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-b2b6d927-38d3-4c47-8e81-8e21f9345817 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] 10.222.0.30 "GET /compute/v2.1/servers/d0f3b23d-c8c0-4e9a-a625-299c00fb2e27" status: 200 len: 1317 microversion: 2.1 time: 0.247406 Dec 24 10:47:36.638986 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 230/456] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:47:36 2021] GET /compute/v2.1/servers/d0f3b23d-c8c0-4e9a-a625-299c00fb2e27 => generated 1317 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 24 10:47:36.693500 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-e5b61920-67e5-42ca-a8a9-3fa6b3341582 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:47:36.694099 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-e5b61920-67e5-42ca-a8a9-3fa6b3341582 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] [instance: a99a6a98-4010-4f8e-a83f-fcc490f6ece0] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:47:36.699850 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-e5b61920-67e5-42ca-a8a9-3fa6b3341582 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:36.700980 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-e5b61920-67e5-42ca-a8a9-3fa6b3341582 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:36.705852 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-e5b61920-67e5-42ca-a8a9-3fa6b3341582 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:36.706332 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-e5b61920-67e5-42ca-a8a9-3fa6b3341582 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:36.854131 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-e5b61920-67e5-42ca-a8a9-3fa6b3341582 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:47:36.864724 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-e5b61920-67e5-42ca-a8a9-3fa6b3341582 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:47:36.866394 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-e5b61920-67e5-42ca-a8a9-3fa6b3341582 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:47:36.867801 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-e5b61920-67e5-42ca-a8a9-3fa6b3341582 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] 10.222.0.30 "GET /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0" status: 200 len: 1723 microversion: 2.20 time: 0.177941 Dec 24 10:47:36.874216 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 231/457] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Dec 24 10:47:36 2021] GET /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0 => generated 1723 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 10:47:36.956362 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-851ffe12-fae7-4d51-b832-eb1ed99555da tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:47:36.957350 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-851ffe12-fae7-4d51-b832-eb1ed99555da tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] [instance: 12183d8e-4c50-449a-a93d-cee72f597b3d] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:47:36.966657 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-851ffe12-fae7-4d51-b832-eb1ed99555da tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:36.969755 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-851ffe12-fae7-4d51-b832-eb1ed99555da tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:36.971694 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-851ffe12-fae7-4d51-b832-eb1ed99555da tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:36.972178 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-851ffe12-fae7-4d51-b832-eb1ed99555da tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:37.124479 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-851ffe12-fae7-4d51-b832-eb1ed99555da tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e2194bc8c0d44b186956c1b38a0c04a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed29a38d2fe424398ac10e585a980df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:47:37.126289 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-851ffe12-fae7-4d51-b832-eb1ed99555da tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] 10.222.0.30 "GET /compute/v2.1/servers/12183d8e-4c50-449a-a93d-cee72f597b3d" status: 200 len: 1359 microversion: 2.1 time: 0.174422 Dec 24 10:47:37.126877 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 232/458] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:47:36 2021] GET /compute/v2.1/servers/12183d8e-4c50-449a-a93d-cee72f597b3d => generated 1359 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:47:37.655175 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-15b5ecb3-64a6-4934-a018-07c7bba98f01 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:47:37.655841 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-15b5ecb3-64a6-4934-a018-07c7bba98f01 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] [instance: d0f3b23d-c8c0-4e9a-a625-299c00fb2e27] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:47:37.662410 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-15b5ecb3-64a6-4934-a018-07c7bba98f01 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:37.662866 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-15b5ecb3-64a6-4934-a018-07c7bba98f01 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:37.663620 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-15b5ecb3-64a6-4934-a018-07c7bba98f01 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:37.664044 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-15b5ecb3-64a6-4934-a018-07c7bba98f01 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:37.805412 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-15b5ecb3-64a6-4934-a018-07c7bba98f01 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ad5096717dc425c849dfe95ea55a6af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62d11172cdf4959a15ac1ffc5601aca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:47:37.812410 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-15b5ecb3-64a6-4934-a018-07c7bba98f01 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] 10.222.0.30 "GET /compute/v2.1/servers/d0f3b23d-c8c0-4e9a-a625-299c00fb2e27" status: 200 len: 1317 microversion: 2.1 time: 0.160841 Dec 24 10:47:37.813004 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 233/459] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:47:37 2021] GET /compute/v2.1/servers/d0f3b23d-c8c0-4e9a-a625-299c00fb2e27 => generated 1317 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 24 10:47:37.889914 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-861adf3f-27ce-42a3-b2a1-e514167dbee9 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:47:37.890513 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-861adf3f-27ce-42a3-b2a1-e514167dbee9 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] [instance: a99a6a98-4010-4f8e-a83f-fcc490f6ece0] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:47:37.897133 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-861adf3f-27ce-42a3-b2a1-e514167dbee9 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:37.897830 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-861adf3f-27ce-42a3-b2a1-e514167dbee9 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:37.898614 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-861adf3f-27ce-42a3-b2a1-e514167dbee9 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:37.899045 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-861adf3f-27ce-42a3-b2a1-e514167dbee9 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:38.074418 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-861adf3f-27ce-42a3-b2a1-e514167dbee9 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:47:38.083555 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-861adf3f-27ce-42a3-b2a1-e514167dbee9 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:47:38.085096 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-861adf3f-27ce-42a3-b2a1-e514167dbee9 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:47:38.086261 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-861adf3f-27ce-42a3-b2a1-e514167dbee9 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] 10.222.0.30 "GET /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0" status: 200 len: 1723 microversion: 2.20 time: 0.200197 Dec 24 10:47:38.086821 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 234/460] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Dec 24 10:47:37 2021] GET /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0 => generated 1723 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 10:47:38.143653 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-a8d67775-cec7-4c14-b20a-0ec94628f01b tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:47:38.144268 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-a8d67775-cec7-4c14-b20a-0ec94628f01b tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] [instance: 12183d8e-4c50-449a-a93d-cee72f597b3d] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:47:38.152220 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-a8d67775-cec7-4c14-b20a-0ec94628f01b tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:38.152849 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-a8d67775-cec7-4c14-b20a-0ec94628f01b tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:38.153748 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-a8d67775-cec7-4c14-b20a-0ec94628f01b tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:38.154250 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-a8d67775-cec7-4c14-b20a-0ec94628f01b tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:38.292477 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-a8d67775-cec7-4c14-b20a-0ec94628f01b tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e2194bc8c0d44b186956c1b38a0c04a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed29a38d2fe424398ac10e585a980df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:47:38.300456 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-a8d67775-cec7-4c14-b20a-0ec94628f01b tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] 10.222.0.30 "GET /compute/v2.1/servers/12183d8e-4c50-449a-a93d-cee72f597b3d" status: 200 len: 1359 microversion: 2.1 time: 0.161296 Dec 24 10:47:38.301052 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 235/461] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:47:38 2021] GET /compute/v2.1/servers/12183d8e-4c50-449a-a93d-cee72f597b3d => generated 1359 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 24 10:47:38.828099 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-b3936f8c-921a-4f1c-8ad4-d837cc4ee588 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:47:38.828699 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-b3936f8c-921a-4f1c-8ad4-d837cc4ee588 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] [instance: d0f3b23d-c8c0-4e9a-a625-299c00fb2e27] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:47:38.841628 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-b3936f8c-921a-4f1c-8ad4-d837cc4ee588 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:38.842441 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-b3936f8c-921a-4f1c-8ad4-d837cc4ee588 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:38.844262 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-b3936f8c-921a-4f1c-8ad4-d837cc4ee588 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:38.845079 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-b3936f8c-921a-4f1c-8ad4-d837cc4ee588 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:39.047966 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-b3936f8c-921a-4f1c-8ad4-d837cc4ee588 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ad5096717dc425c849dfe95ea55a6af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62d11172cdf4959a15ac1ffc5601aca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:47:39.055556 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-b3936f8c-921a-4f1c-8ad4-d837cc4ee588 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] 10.222.0.30 "GET /compute/v2.1/servers/d0f3b23d-c8c0-4e9a-a625-299c00fb2e27" status: 200 len: 1317 microversion: 2.1 time: 0.230857 Dec 24 10:47:39.056647 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 236/462] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:47:38 2021] GET /compute/v2.1/servers/d0f3b23d-c8c0-4e9a-a625-299c00fb2e27 => generated 1317 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 24 10:47:39.113634 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-7a6d874d-1406-4a25-bd05-9be116ae994c tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:47:39.114605 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-7a6d874d-1406-4a25-bd05-9be116ae994c tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] [instance: a99a6a98-4010-4f8e-a83f-fcc490f6ece0] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:47:39.131005 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-7a6d874d-1406-4a25-bd05-9be116ae994c tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:39.131454 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-7a6d874d-1406-4a25-bd05-9be116ae994c tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:39.132260 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-7a6d874d-1406-4a25-bd05-9be116ae994c tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:39.132697 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-7a6d874d-1406-4a25-bd05-9be116ae994c tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:39.305321 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-7a6d874d-1406-4a25-bd05-9be116ae994c tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:47:39.317317 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-7a6d874d-1406-4a25-bd05-9be116ae994c tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:47:39.318821 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-7a6d874d-1406-4a25-bd05-9be116ae994c tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:47:39.319997 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-7a6d874d-1406-4a25-bd05-9be116ae994c tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] 10.222.0.30 "GET /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0" status: 200 len: 1723 microversion: 2.20 time: 0.214204 Dec 24 10:47:39.320714 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 237/463] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Dec 24 10:47:39 2021] GET /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0 => generated 1723 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 24 10:47:39.325288 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-2c0a5217-239e-43f3-9b71-be62b52691bb tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:47:39.326651 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-2c0a5217-239e-43f3-9b71-be62b52691bb tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] [instance: 12183d8e-4c50-449a-a93d-cee72f597b3d] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:47:39.332922 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-2c0a5217-239e-43f3-9b71-be62b52691bb tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:39.333428 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-2c0a5217-239e-43f3-9b71-be62b52691bb tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:39.334249 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-2c0a5217-239e-43f3-9b71-be62b52691bb tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:39.334692 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-2c0a5217-239e-43f3-9b71-be62b52691bb tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:39.506713 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-2c0a5217-239e-43f3-9b71-be62b52691bb tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e2194bc8c0d44b186956c1b38a0c04a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed29a38d2fe424398ac10e585a980df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:47:39.511738 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-2c0a5217-239e-43f3-9b71-be62b52691bb tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] 10.222.0.30 "GET /compute/v2.1/servers/12183d8e-4c50-449a-a93d-cee72f597b3d" status: 200 len: 1359 microversion: 2.1 time: 0.188622 Dec 24 10:47:39.515496 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 238/464] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:47:39 2021] GET /compute/v2.1/servers/12183d8e-4c50-449a-a93d-cee72f597b3d => generated 1359 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:47:40.072587 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-4e731843-a57d-41a8-b619-fe346eb17b87 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:47:40.073298 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-4e731843-a57d-41a8-b619-fe346eb17b87 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] [instance: d0f3b23d-c8c0-4e9a-a625-299c00fb2e27] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:47:40.079792 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-4e731843-a57d-41a8-b619-fe346eb17b87 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:40.080595 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-4e731843-a57d-41a8-b619-fe346eb17b87 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:40.081404 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-4e731843-a57d-41a8-b619-fe346eb17b87 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:40.081760 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-4e731843-a57d-41a8-b619-fe346eb17b87 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:40.283004 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-4e731843-a57d-41a8-b619-fe346eb17b87 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ad5096717dc425c849dfe95ea55a6af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62d11172cdf4959a15ac1ffc5601aca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:47:40.307758 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-4e731843-a57d-41a8-b619-fe346eb17b87 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] 10.222.0.30 "GET /compute/v2.1/servers/d0f3b23d-c8c0-4e9a-a625-299c00fb2e27" status: 200 len: 1317 microversion: 2.1 time: 0.238572 Dec 24 10:47:40.315099 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 239/465] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:47:40 2021] GET /compute/v2.1/servers/d0f3b23d-c8c0-4e9a-a625-299c00fb2e27 => generated 1317 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 24 10:47:40.338970 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-1844d9b9-4290-47af-a4cf-e1a76f983582 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:47:40.339580 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-1844d9b9-4290-47af-a4cf-e1a76f983582 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] [instance: a99a6a98-4010-4f8e-a83f-fcc490f6ece0] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:47:40.348978 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-1844d9b9-4290-47af-a4cf-e1a76f983582 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:40.351210 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-1844d9b9-4290-47af-a4cf-e1a76f983582 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:40.352918 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-1844d9b9-4290-47af-a4cf-e1a76f983582 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:40.353563 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-1844d9b9-4290-47af-a4cf-e1a76f983582 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:40.534448 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-1844d9b9-4290-47af-a4cf-e1a76f983582 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:47:40.558966 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-1844d9b9-4290-47af-a4cf-e1a76f983582 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:47:40.558966 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-1844d9b9-4290-47af-a4cf-e1a76f983582 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:47:40.558966 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-1844d9b9-4290-47af-a4cf-e1a76f983582 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] 10.222.0.30 "GET /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0" status: 200 len: 1723 microversion: 2.20 time: 0.211708 Dec 24 10:47:40.559949 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 240/466] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Dec 24 10:47:40 2021] GET /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0 => generated 1723 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 24 10:47:40.559949 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-cbec4b14-1f00-4e79-9437-bc0abb67040d tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:47:40.559949 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-cbec4b14-1f00-4e79-9437-bc0abb67040d tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] [instance: 12183d8e-4c50-449a-a93d-cee72f597b3d] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:47:40.560411 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-cbec4b14-1f00-4e79-9437-bc0abb67040d tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:40.560507 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-cbec4b14-1f00-4e79-9437-bc0abb67040d tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:40.561277 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-cbec4b14-1f00-4e79-9437-bc0abb67040d tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:40.561715 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-cbec4b14-1f00-4e79-9437-bc0abb67040d tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:40.707656 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-cbec4b14-1f00-4e79-9437-bc0abb67040d tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e2194bc8c0d44b186956c1b38a0c04a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed29a38d2fe424398ac10e585a980df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:47:40.716885 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-cbec4b14-1f00-4e79-9437-bc0abb67040d tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] 10.222.0.30 "GET /compute/v2.1/servers/12183d8e-4c50-449a-a93d-cee72f597b3d" status: 200 len: 1359 microversion: 2.1 time: 0.168028 Dec 24 10:47:40.717469 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 241/467] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:47:40 2021] GET /compute/v2.1/servers/12183d8e-4c50-449a-a93d-cee72f597b3d => generated 1359 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:47:41.323367 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-e214302d-4adc-4b7a-887d-95def8059475 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] 10.222.0.30 "POST /compute/v2.1/servers/9330dbb8-edad-4d54-afeb-8badc464250d/action" status: 200 len: 33050 microversion: 2.1 time: 13.977134 Dec 24 10:47:41.325573 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 227/468] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Dec 24 10:47:27 2021] POST /compute/v2.1/servers/9330dbb8-edad-4d54-afeb-8badc464250d/action => generated 33050 bytes in 13979 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 24 10:47:41.334582 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-297c2c2e-fc55-4780-a775-cf5dc74be1db tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:47:41.336035 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-297c2c2e-fc55-4780-a775-cf5dc74be1db tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] [instance: d0f3b23d-c8c0-4e9a-a625-299c00fb2e27] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:47:41.348594 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-297c2c2e-fc55-4780-a775-cf5dc74be1db tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:41.350538 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-297c2c2e-fc55-4780-a775-cf5dc74be1db tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:41.355059 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-297c2c2e-fc55-4780-a775-cf5dc74be1db tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:41.355748 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-297c2c2e-fc55-4780-a775-cf5dc74be1db tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:41.567145 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-da3a993d-6d22-4cdf-84c3-12607de2b9f7 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:47:41.567832 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-da3a993d-6d22-4cdf-84c3-12607de2b9f7 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] [instance: a99a6a98-4010-4f8e-a83f-fcc490f6ece0] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:47:41.592904 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-da3a993d-6d22-4cdf-84c3-12607de2b9f7 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:41.598840 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-da3a993d-6d22-4cdf-84c3-12607de2b9f7 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:41.598840 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-da3a993d-6d22-4cdf-84c3-12607de2b9f7 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:41.598840 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-da3a993d-6d22-4cdf-84c3-12607de2b9f7 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:41.664977 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-297c2c2e-fc55-4780-a775-cf5dc74be1db tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ad5096717dc425c849dfe95ea55a6af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62d11172cdf4959a15ac1ffc5601aca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:47:41.672229 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-297c2c2e-fc55-4780-a775-cf5dc74be1db tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] 10.222.0.30 "GET /compute/v2.1/servers/d0f3b23d-c8c0-4e9a-a625-299c00fb2e27" status: 200 len: 1317 microversion: 2.1 time: 0.341917 Dec 24 10:47:41.672808 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 242/469] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:47:41 2021] GET /compute/v2.1/servers/d0f3b23d-c8c0-4e9a-a625-299c00fb2e27 => generated 1317 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:47:41.737502 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-eb6d6a1d-8dd7-412d-a26f-12dcdbc566a9 tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:47:41.738260 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-eb6d6a1d-8dd7-412d-a26f-12dcdbc566a9 tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] [instance: 12183d8e-4c50-449a-a93d-cee72f597b3d] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:47:41.744756 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-eb6d6a1d-8dd7-412d-a26f-12dcdbc566a9 tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:41.745876 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-eb6d6a1d-8dd7-412d-a26f-12dcdbc566a9 tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:41.746697 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-eb6d6a1d-8dd7-412d-a26f-12dcdbc566a9 tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:41.747401 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-eb6d6a1d-8dd7-412d-a26f-12dcdbc566a9 tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:41.910086 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-da3a993d-6d22-4cdf-84c3-12607de2b9f7 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:47:41.919111 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-da3a993d-6d22-4cdf-84c3-12607de2b9f7 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:47:41.920981 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-da3a993d-6d22-4cdf-84c3-12607de2b9f7 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:47:41.929628 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-da3a993d-6d22-4cdf-84c3-12607de2b9f7 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] 10.222.0.30 "GET /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0" status: 200 len: 1723 microversion: 2.20 time: 0.367109 Dec 24 10:47:41.941349 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 228/470] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Dec 24 10:47:41 2021] GET /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0 => generated 1723 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 24 10:47:41.990303 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-eb6d6a1d-8dd7-412d-a26f-12dcdbc566a9 tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e2194bc8c0d44b186956c1b38a0c04a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed29a38d2fe424398ac10e585a980df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:47:41.998729 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-eb6d6a1d-8dd7-412d-a26f-12dcdbc566a9 tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] 10.222.0.30 "GET /compute/v2.1/servers/12183d8e-4c50-449a-a93d-cee72f597b3d" status: 200 len: 1359 microversion: 2.1 time: 0.267971 Dec 24 10:47:42.007383 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 243/471] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:47:41 2021] GET /compute/v2.1/servers/12183d8e-4c50-449a-a93d-cee72f597b3d => generated 1359 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 24 10:47:42.336194 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-89197222-2824-410e-ba4f-67902498c1e3 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:47:42.339164 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-89197222-2824-410e-ba4f-67902498c1e3 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] [instance: 9330dbb8-edad-4d54-afeb-8badc464250d] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:47:42.343971 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-89197222-2824-410e-ba4f-67902498c1e3 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:42.344485 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-89197222-2824-410e-ba4f-67902498c1e3 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:42.345367 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-89197222-2824-410e-ba4f-67902498c1e3 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:42.346470 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-89197222-2824-410e-ba4f-67902498c1e3 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:42.463551 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-89197222-2824-410e-ba4f-67902498c1e3 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] 10.222.0.30 "POST /compute/v2.1/servers/9330dbb8-edad-4d54-afeb-8badc464250d/action" status: 200 len: 33410 microversion: 2.1 time: 0.130114 Dec 24 10:47:42.464158 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 229/472] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Dec 24 10:47:42 2021] POST /compute/v2.1/servers/9330dbb8-edad-4d54-afeb-8badc464250d/action => generated 33410 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 24 10:47:42.690792 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-a6ffbd86-2209-477b-974e-bca4f3035af6 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:47:42.691747 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-a6ffbd86-2209-477b-974e-bca4f3035af6 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] [instance: d0f3b23d-c8c0-4e9a-a625-299c00fb2e27] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:47:42.701367 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-a6ffbd86-2209-477b-974e-bca4f3035af6 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:42.702086 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-a6ffbd86-2209-477b-974e-bca4f3035af6 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:42.703232 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-a6ffbd86-2209-477b-974e-bca4f3035af6 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:42.703929 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-a6ffbd86-2209-477b-974e-bca4f3035af6 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:42.888228 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-a6ffbd86-2209-477b-974e-bca4f3035af6 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ad5096717dc425c849dfe95ea55a6af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62d11172cdf4959a15ac1ffc5601aca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:47:42.895822 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-a6ffbd86-2209-477b-974e-bca4f3035af6 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] 10.222.0.30 "GET /compute/v2.1/servers/d0f3b23d-c8c0-4e9a-a625-299c00fb2e27" status: 200 len: 1317 microversion: 2.1 time: 0.210415 Dec 24 10:47:42.896334 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 244/473] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:47:42 2021] GET /compute/v2.1/servers/d0f3b23d-c8c0-4e9a-a625-299c00fb2e27 => generated 1317 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:47:42.951110 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-89905fff-3f09-41fc-a502-d901e09cf0ed tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:47:42.951794 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-89905fff-3f09-41fc-a502-d901e09cf0ed tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] [instance: a99a6a98-4010-4f8e-a83f-fcc490f6ece0] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:47:42.958781 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-89905fff-3f09-41fc-a502-d901e09cf0ed tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:42.959220 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-89905fff-3f09-41fc-a502-d901e09cf0ed tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:42.960091 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-89905fff-3f09-41fc-a502-d901e09cf0ed tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:42.960450 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-89905fff-3f09-41fc-a502-d901e09cf0ed tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:43.016453 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-eb26af85-8a38-464f-b322-ca3592e93b66 tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:47:43.017283 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-eb26af85-8a38-464f-b322-ca3592e93b66 tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] [instance: 12183d8e-4c50-449a-a93d-cee72f597b3d] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:47:43.025483 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-eb26af85-8a38-464f-b322-ca3592e93b66 tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:43.026199 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-eb26af85-8a38-464f-b322-ca3592e93b66 tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:43.027150 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-eb26af85-8a38-464f-b322-ca3592e93b66 tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:43.027731 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-eb26af85-8a38-464f-b322-ca3592e93b66 tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:43.242373 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-eb26af85-8a38-464f-b322-ca3592e93b66 tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e2194bc8c0d44b186956c1b38a0c04a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed29a38d2fe424398ac10e585a980df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:47:43.253057 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-eb26af85-8a38-464f-b322-ca3592e93b66 tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] 10.222.0.30 "GET /compute/v2.1/servers/12183d8e-4c50-449a-a93d-cee72f597b3d" status: 200 len: 1359 microversion: 2.1 time: 0.239913 Dec 24 10:47:43.257709 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 245/474] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:47:43 2021] GET /compute/v2.1/servers/12183d8e-4c50-449a-a93d-cee72f597b3d => generated 1359 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 24 10:47:43.343982 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-89905fff-3f09-41fc-a502-d901e09cf0ed tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:47:43.362284 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-89905fff-3f09-41fc-a502-d901e09cf0ed tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:47:43.362284 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-89905fff-3f09-41fc-a502-d901e09cf0ed tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:47:43.362284 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-89905fff-3f09-41fc-a502-d901e09cf0ed tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] 10.222.0.30 "GET /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0" status: 200 len: 1744 microversion: 2.20 time: 0.413039 Dec 24 10:47:43.362543 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 230/475] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Dec 24 10:47:42 2021] GET /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0 => generated 1744 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 10:47:43.474981 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-bafdac50-130d-4886-91f7-aafb31da1b97 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:47:43.476502 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-bafdac50-130d-4886-91f7-aafb31da1b97 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] [instance: 9330dbb8-edad-4d54-afeb-8badc464250d] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:47:43.485836 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-bafdac50-130d-4886-91f7-aafb31da1b97 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:43.486808 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-bafdac50-130d-4886-91f7-aafb31da1b97 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:43.487615 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-bafdac50-130d-4886-91f7-aafb31da1b97 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:43.488263 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-bafdac50-130d-4886-91f7-aafb31da1b97 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:43.600556 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-c76180ce-500a-481f-b1aa-5692ef043839 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:47:43.601989 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-c76180ce-500a-481f-b1aa-5692ef043839 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] [instance: 54d2f913-8385-4f34-8cb0-8c0f08c7a30f] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:47:43.617138 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-bafdac50-130d-4886-91f7-aafb31da1b97 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] 10.222.0.30 "POST /compute/v2.1/servers/9330dbb8-edad-4d54-afeb-8badc464250d/action" status: 200 len: 33825 microversion: 2.1 time: 0.144917 Dec 24 10:47:43.619699 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-c76180ce-500a-481f-b1aa-5692ef043839 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:43.620598 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-c76180ce-500a-481f-b1aa-5692ef043839 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:43.622379 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-c76180ce-500a-481f-b1aa-5692ef043839 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:43.623228 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 246/476] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Dec 24 10:47:43 2021] POST /compute/v2.1/servers/9330dbb8-edad-4d54-afeb-8badc464250d/action => generated 33825 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 24 10:47:43.626225 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-c76180ce-500a-481f-b1aa-5692ef043839 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:43.656146 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.objects.instance [None req-c76180ce-500a-481f-b1aa-5692ef043839 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lazy-loading 'flavor' on Instance uuid 54d2f913-8385-4f34-8cb0-8c0f08c7a30f {{(pid=123431) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 24 10:47:43.913710 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-84696aac-299f-491b-b71b-90afd7a91042 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:47:43.915344 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-84696aac-299f-491b-b71b-90afd7a91042 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] [instance: d0f3b23d-c8c0-4e9a-a625-299c00fb2e27] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:47:43.926275 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-84696aac-299f-491b-b71b-90afd7a91042 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:43.926724 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-84696aac-299f-491b-b71b-90afd7a91042 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:43.927543 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-84696aac-299f-491b-b71b-90afd7a91042 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:43.927970 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-84696aac-299f-491b-b71b-90afd7a91042 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:44.075368 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-84696aac-299f-491b-b71b-90afd7a91042 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ad5096717dc425c849dfe95ea55a6af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62d11172cdf4959a15ac1ffc5601aca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:47:44.084000 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-84696aac-299f-491b-b71b-90afd7a91042 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] 10.222.0.30 "GET /compute/v2.1/servers/d0f3b23d-c8c0-4e9a-a625-299c00fb2e27" status: 200 len: 1507 microversion: 2.1 time: 0.174378 Dec 24 10:47:44.084573 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 247/477] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:47:43 2021] GET /compute/v2.1/servers/d0f3b23d-c8c0-4e9a-a625-299c00fb2e27 => generated 1507 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:47:44.102188 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-c76180ce-500a-481f-b1aa-5692ef043839 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] 10.222.0.30 "POST /compute/v2.1/servers/54d2f913-8385-4f34-8cb0-8c0f08c7a30f/action" status: 200 len: 32 microversion: 2.1 time: 0.505580 Dec 24 10:47:44.105462 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 231/478] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Dec 24 10:47:43 2021] POST /compute/v2.1/servers/54d2f913-8385-4f34-8cb0-8c0f08c7a30f/action => generated 32 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 24 10:47:44.114177 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-5c77a746-355c-4a19-938c-4173689aa46e tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:47:44.114867 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-5c77a746-355c-4a19-938c-4173689aa46e tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] [instance: 54d2f913-8385-4f34-8cb0-8c0f08c7a30f] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:47:44.121935 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-5c77a746-355c-4a19-938c-4173689aa46e tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:44.126116 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-5c77a746-355c-4a19-938c-4173689aa46e tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:44.127273 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-5c77a746-355c-4a19-938c-4173689aa46e tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:44.129467 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-5c77a746-355c-4a19-938c-4173689aa46e tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:44.274147 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-a44d30fc-5f5d-47ed-b27a-8b0a022f8d97 tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:47:44.275219 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-a44d30fc-5f5d-47ed-b27a-8b0a022f8d97 tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] [instance: 12183d8e-4c50-449a-a93d-cee72f597b3d] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:47:44.283750 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-a44d30fc-5f5d-47ed-b27a-8b0a022f8d97 tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:44.283750 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-a44d30fc-5f5d-47ed-b27a-8b0a022f8d97 tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:44.284060 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-a44d30fc-5f5d-47ed-b27a-8b0a022f8d97 tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:44.284260 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-a44d30fc-5f5d-47ed-b27a-8b0a022f8d97 tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:44.329059 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-5c77a746-355c-4a19-938c-4173689aa46e tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d627b760f74f48ac560e2ce2e74e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '378bb44ad89440e49f7e290a5d31004e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:47:44.336978 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-5c77a746-355c-4a19-938c-4173689aa46e tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] 10.222.0.30 "GET /compute/v2.1/servers/54d2f913-8385-4f34-8cb0-8c0f08c7a30f" status: 200 len: 1568 microversion: 2.1 time: 0.226916 Dec 24 10:47:44.339753 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 248/479] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:47:44 2021] GET /compute/v2.1/servers/54d2f913-8385-4f34-8cb0-8c0f08c7a30f => generated 1568 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:47:44.379559 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-3318391a-f1d7-4b0c-a4e5-b2ddd1d37cef tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:47:44.379954 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-3318391a-f1d7-4b0c-a4e5-b2ddd1d37cef tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] [instance: a99a6a98-4010-4f8e-a83f-fcc490f6ece0] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:47:44.389922 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-3318391a-f1d7-4b0c-a4e5-b2ddd1d37cef tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:44.391458 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-3318391a-f1d7-4b0c-a4e5-b2ddd1d37cef tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:44.393697 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-3318391a-f1d7-4b0c-a4e5-b2ddd1d37cef tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:44.395042 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-3318391a-f1d7-4b0c-a4e5-b2ddd1d37cef tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:44.460965 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-a44d30fc-5f5d-47ed-b27a-8b0a022f8d97 tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e2194bc8c0d44b186956c1b38a0c04a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed29a38d2fe424398ac10e585a980df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:47:44.469183 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-a44d30fc-5f5d-47ed-b27a-8b0a022f8d97 tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] 10.222.0.30 "GET /compute/v2.1/servers/12183d8e-4c50-449a-a93d-cee72f597b3d" status: 200 len: 1359 microversion: 2.1 time: 0.199461 Dec 24 10:47:44.470191 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 232/480] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:47:44 2021] GET /compute/v2.1/servers/12183d8e-4c50-449a-a93d-cee72f597b3d => generated 1359 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 24 10:47:44.631275 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-f9362671-77d8-457b-baf1-792ac12e4127 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:47:44.632702 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-f9362671-77d8-457b-baf1-792ac12e4127 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] [instance: 9330dbb8-edad-4d54-afeb-8badc464250d] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:47:44.640179 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-f9362671-77d8-457b-baf1-792ac12e4127 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:44.641016 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-f9362671-77d8-457b-baf1-792ac12e4127 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:44.642070 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-f9362671-77d8-457b-baf1-792ac12e4127 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:44.642820 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-f9362671-77d8-457b-baf1-792ac12e4127 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:44.647553 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-3318391a-f1d7-4b0c-a4e5-b2ddd1d37cef tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:47:44.655739 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-3318391a-f1d7-4b0c-a4e5-b2ddd1d37cef tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:47:44.657310 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-3318391a-f1d7-4b0c-a4e5-b2ddd1d37cef tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:47:44.659009 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-3318391a-f1d7-4b0c-a4e5-b2ddd1d37cef tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] 10.222.0.30 "GET /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0" status: 200 len: 1744 microversion: 2.20 time: 0.284008 Dec 24 10:47:44.662298 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 249/481] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Dec 24 10:47:44 2021] GET /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0 => generated 1744 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 24 10:47:44.768257 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-f9362671-77d8-457b-baf1-792ac12e4127 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] 10.222.0.30 "POST /compute/v2.1/servers/9330dbb8-edad-4d54-afeb-8badc464250d/action" status: 200 len: 34589 microversion: 2.1 time: 0.140881 Dec 24 10:47:44.769014 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 233/482] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Dec 24 10:47:44 2021] POST /compute/v2.1/servers/9330dbb8-edad-4d54-afeb-8badc464250d/action => generated 34589 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 24 10:47:45.355214 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-a2c14d9a-debb-4a9c-97af-adad8ef6dc41 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:47:45.356383 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-a2c14d9a-debb-4a9c-97af-adad8ef6dc41 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] [instance: 54d2f913-8385-4f34-8cb0-8c0f08c7a30f] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:47:45.363083 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-a2c14d9a-debb-4a9c-97af-adad8ef6dc41 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:45.363749 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-a2c14d9a-debb-4a9c-97af-adad8ef6dc41 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:45.364533 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-a2c14d9a-debb-4a9c-97af-adad8ef6dc41 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:45.364993 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-a2c14d9a-debb-4a9c-97af-adad8ef6dc41 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:45.493258 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-e30cae8d-7f21-40c2-94d7-84cef010355f tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:47:45.494843 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-e30cae8d-7f21-40c2-94d7-84cef010355f tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] [instance: 12183d8e-4c50-449a-a93d-cee72f597b3d] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:47:45.502791 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-e30cae8d-7f21-40c2-94d7-84cef010355f tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:45.503487 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-e30cae8d-7f21-40c2-94d7-84cef010355f tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:45.504490 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-e30cae8d-7f21-40c2-94d7-84cef010355f tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:45.505210 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-e30cae8d-7f21-40c2-94d7-84cef010355f tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:45.505679 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-a2c14d9a-debb-4a9c-97af-adad8ef6dc41 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d627b760f74f48ac560e2ce2e74e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '378bb44ad89440e49f7e290a5d31004e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:47:45.516204 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-a2c14d9a-debb-4a9c-97af-adad8ef6dc41 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] 10.222.0.30 "GET /compute/v2.1/servers/54d2f913-8385-4f34-8cb0-8c0f08c7a30f" status: 200 len: 1568 microversion: 2.1 time: 0.163805 Dec 24 10:47:45.516991 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 250/483] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:47:45 2021] GET /compute/v2.1/servers/54d2f913-8385-4f34-8cb0-8c0f08c7a30f => generated 1568 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:47:45.574824 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [req-da6a452c-10aa-43a8-84d0-5252c0dc3080 req-c6181810-b356-4cf8-8132-00c48c3b7881 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a99a6a98-4010-4f8e-a83f-fcc490f6ece0", "name": "network-vif-plugged", "status": "completed", "tag": "e50dfc57-62cb-4d13-9e17-f48edcdb1dcc"}]} {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:47:45.576698 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 10:47:45.576698 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: warnings.warn(msg) Dec 24 10:47:45.585535 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [req-da6a452c-10aa-43a8-84d0-5252c0dc3080 req-c6181810-b356-4cf8-8132-00c48c3b7881 service nova] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:45.586048 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [req-da6a452c-10aa-43a8-84d0-5252c0dc3080 req-c6181810-b356-4cf8-8132-00c48c3b7881 service nova] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:45.600603 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.compute.server_external_events [req-da6a452c-10aa-43a8-84d0-5252c0dc3080 req-c6181810-b356-4cf8-8132-00c48c3b7881 service nova] Creating event network-vif-plugged:e50dfc57-62cb-4d13-9e17-f48edcdb1dcc for instance a99a6a98-4010-4f8e-a83f-fcc490f6ece0 on hv-cinder-81644 Dec 24 10:47:45.609149 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [req-da6a452c-10aa-43a8-84d0-5252c0dc3080 req-c6181810-b356-4cf8-8132-00c48c3b7881 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037545 Dec 24 10:47:45.610374 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 251/484] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Dec 24 10:47:45 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 10:47:45.689158 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-4744ac1f-c7d7-4ffe-9cdf-a44b0f78118f tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:47:45.689158 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-4744ac1f-c7d7-4ffe-9cdf-a44b0f78118f tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] [instance: a99a6a98-4010-4f8e-a83f-fcc490f6ece0] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:47:45.689158 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-4744ac1f-c7d7-4ffe-9cdf-a44b0f78118f tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:45.689158 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-4744ac1f-c7d7-4ffe-9cdf-a44b0f78118f tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:45.690068 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-4744ac1f-c7d7-4ffe-9cdf-a44b0f78118f tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:45.690068 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-4744ac1f-c7d7-4ffe-9cdf-a44b0f78118f tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:45.713440 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-e30cae8d-7f21-40c2-94d7-84cef010355f tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e2194bc8c0d44b186956c1b38a0c04a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed29a38d2fe424398ac10e585a980df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:47:45.720635 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-e30cae8d-7f21-40c2-94d7-84cef010355f tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] 10.222.0.30 "GET /compute/v2.1/servers/12183d8e-4c50-449a-a93d-cee72f597b3d" status: 200 len: 1359 microversion: 2.1 time: 0.234097 Dec 24 10:47:45.730351 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 234/485] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:47:45 2021] GET /compute/v2.1/servers/12183d8e-4c50-449a-a93d-cee72f597b3d => generated 1359 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:47:45.780528 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-161d3790-9634-4e90-91c1-dd47b22e9bf4 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:47:45.782494 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-161d3790-9634-4e90-91c1-dd47b22e9bf4 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] [instance: 9330dbb8-edad-4d54-afeb-8badc464250d] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:47:45.795444 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-161d3790-9634-4e90-91c1-dd47b22e9bf4 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:45.796139 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-161d3790-9634-4e90-91c1-dd47b22e9bf4 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:45.798534 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-161d3790-9634-4e90-91c1-dd47b22e9bf4 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:45.799826 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-161d3790-9634-4e90-91c1-dd47b22e9bf4 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:45.865955 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-4744ac1f-c7d7-4ffe-9cdf-a44b0f78118f tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:47:45.878517 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-4744ac1f-c7d7-4ffe-9cdf-a44b0f78118f tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:47:45.880005 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-4744ac1f-c7d7-4ffe-9cdf-a44b0f78118f tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:47:45.881471 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-4744ac1f-c7d7-4ffe-9cdf-a44b0f78118f tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] 10.222.0.30 "GET /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0" status: 200 len: 1739 microversion: 2.20 time: 0.208204 Dec 24 10:47:45.882373 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 252/486] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Dec 24 10:47:45 2021] GET /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0 => generated 1739 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 24 10:47:45.922142 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-161d3790-9634-4e90-91c1-dd47b22e9bf4 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] 10.222.0.30 "POST /compute/v2.1/servers/9330dbb8-edad-4d54-afeb-8badc464250d/action" status: 200 len: 35356 microversion: 2.1 time: 0.145468 Dec 24 10:47:45.924868 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 235/487] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Dec 24 10:47:45 2021] POST /compute/v2.1/servers/9330dbb8-edad-4d54-afeb-8badc464250d/action => generated 35356 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 24 10:47:46.069313 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-7c8b7d74-303d-4b89-90d2-2e95f7d078b8 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4581f73b-fab8-4ac1-b2e2-078f5ef208db"}} {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:47:46.070482 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-7c8b7d74-303d-4b89-90d2-2e95f7d078b8 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] [instance: d0f3b23d-c8c0-4e9a-a625-299c00fb2e27] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:47:46.077297 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-7c8b7d74-303d-4b89-90d2-2e95f7d078b8 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:46.077752 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-7c8b7d74-303d-4b89-90d2-2e95f7d078b8 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:46.079071 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-7c8b7d74-303d-4b89-90d2-2e95f7d078b8 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:46.079681 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-7c8b7d74-303d-4b89-90d2-2e95f7d078b8 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:46.537911 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-8794a647-713f-4748-b956-1e408cbad985 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:47:46.538525 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-8794a647-713f-4748-b956-1e408cbad985 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] [instance: 54d2f913-8385-4f34-8cb0-8c0f08c7a30f] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:47:46.546160 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-8794a647-713f-4748-b956-1e408cbad985 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:46.546915 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-8794a647-713f-4748-b956-1e408cbad985 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:46.547887 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-8794a647-713f-4748-b956-1e408cbad985 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:46.548485 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-8794a647-713f-4748-b956-1e408cbad985 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:46.801580 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-8794a647-713f-4748-b956-1e408cbad985 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d627b760f74f48ac560e2ce2e74e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '378bb44ad89440e49f7e290a5d31004e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:47:46.818476 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-8794a647-713f-4748-b956-1e408cbad985 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] 10.222.0.30 "GET /compute/v2.1/servers/54d2f913-8385-4f34-8cb0-8c0f08c7a30f" status: 200 len: 1568 microversion: 2.1 time: 0.287948 Dec 24 10:47:46.819994 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 236/488] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:47:46 2021] GET /compute/v2.1/servers/54d2f913-8385-4f34-8cb0-8c0f08c7a30f => generated 1568 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:47:46.825638 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-4efbc669-f4e6-4e81-9ec2-e0b9ba004f8c tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:47:46.826582 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-4efbc669-f4e6-4e81-9ec2-e0b9ba004f8c tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] [instance: 12183d8e-4c50-449a-a93d-cee72f597b3d] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:47:46.834807 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-4efbc669-f4e6-4e81-9ec2-e0b9ba004f8c tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:46.835610 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-4efbc669-f4e6-4e81-9ec2-e0b9ba004f8c tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:46.836646 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-4efbc669-f4e6-4e81-9ec2-e0b9ba004f8c tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:46.837322 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-4efbc669-f4e6-4e81-9ec2-e0b9ba004f8c tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:47.048196 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-4efbc669-f4e6-4e81-9ec2-e0b9ba004f8c tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e2194bc8c0d44b186956c1b38a0c04a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed29a38d2fe424398ac10e585a980df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:47:47.062361 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-4efbc669-f4e6-4e81-9ec2-e0b9ba004f8c tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] 10.222.0.30 "GET /compute/v2.1/servers/12183d8e-4c50-449a-a93d-cee72f597b3d" status: 200 len: 1359 microversion: 2.1 time: 0.239383 Dec 24 10:47:47.063154 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 237/489] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:47:46 2021] GET /compute/v2.1/servers/12183d8e-4c50-449a-a93d-cee72f597b3d => generated 1359 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:47:47.067863 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-b2410bcc-c0b9-43d2-b038-bb96ae1cef9c tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:47:47.068651 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-b2410bcc-c0b9-43d2-b038-bb96ae1cef9c tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] [instance: a99a6a98-4010-4f8e-a83f-fcc490f6ece0] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:47:47.075065 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-b2410bcc-c0b9-43d2-b038-bb96ae1cef9c tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:47.075707 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-b2410bcc-c0b9-43d2-b038-bb96ae1cef9c tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:47.076771 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-b2410bcc-c0b9-43d2-b038-bb96ae1cef9c tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:47.077473 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-b2410bcc-c0b9-43d2-b038-bb96ae1cef9c tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:47.180348 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-7c8b7d74-303d-4b89-90d2-2e95f7d078b8 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] 10.222.0.30 "POST /compute/v2.1/servers/d0f3b23d-c8c0-4e9a-a625-299c00fb2e27/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.114672 Dec 24 10:47:47.182090 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 253/490] 10.222.0.30 () {60 vars in 1322 bytes} [Fri Dec 24 10:47:46 2021] POST /compute/v2.1/servers/d0f3b23d-c8c0-4e9a-a625-299c00fb2e27/os-volume_attachments => generated 194 bytes in 1117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 10:47:47.209211 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-893f24a9-a60e-4811-9269-b2afc9f6e97d tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:47:47.215593 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-893f24a9-a60e-4811-9269-b2afc9f6e97d tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] [instance: 9330dbb8-edad-4d54-afeb-8badc464250d] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:47:47.235718 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-893f24a9-a60e-4811-9269-b2afc9f6e97d tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:47.241610 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-893f24a9-a60e-4811-9269-b2afc9f6e97d tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:47.242665 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-893f24a9-a60e-4811-9269-b2afc9f6e97d tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:47.246938 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-893f24a9-a60e-4811-9269-b2afc9f6e97d tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:47.356613 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-b2410bcc-c0b9-43d2-b038-bb96ae1cef9c tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:47:47.371606 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-b2410bcc-c0b9-43d2-b038-bb96ae1cef9c tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:47:47.373637 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-b2410bcc-c0b9-43d2-b038-bb96ae1cef9c tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:47:47.376234 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-b2410bcc-c0b9-43d2-b038-bb96ae1cef9c tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] 10.222.0.30 "GET /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0" status: 200 len: 1739 microversion: 2.20 time: 0.311947 Dec 24 10:47:47.377467 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 238/491] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Dec 24 10:47:47 2021] GET /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0 => generated 1739 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 10:47:47.385157 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-893f24a9-a60e-4811-9269-b2afc9f6e97d tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] 10.222.0.30 "POST /compute/v2.1/servers/9330dbb8-edad-4d54-afeb-8badc464250d/action" status: 200 len: 36727 microversion: 2.1 time: 0.201106 Dec 24 10:47:47.392779 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 254/492] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Dec 24 10:47:47 2021] POST /compute/v2.1/servers/9330dbb8-edad-4d54-afeb-8badc464250d/action => generated 36727 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 24 10:47:47.838259 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-35459493-f2d1-4dc1-b12c-6507cd06448d tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:47:47.838869 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-35459493-f2d1-4dc1-b12c-6507cd06448d tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] [instance: 54d2f913-8385-4f34-8cb0-8c0f08c7a30f] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:47:47.847583 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-35459493-f2d1-4dc1-b12c-6507cd06448d tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:47.848027 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-35459493-f2d1-4dc1-b12c-6507cd06448d tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:47.848910 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-35459493-f2d1-4dc1-b12c-6507cd06448d tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:47.849276 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-35459493-f2d1-4dc1-b12c-6507cd06448d tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:48.084843 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-f502a133-3093-44d0-9866-3cdfe37da92f tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:47:48.085926 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-f502a133-3093-44d0-9866-3cdfe37da92f tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] [instance: 12183d8e-4c50-449a-a93d-cee72f597b3d] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:47:48.107725 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-f502a133-3093-44d0-9866-3cdfe37da92f tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:48.108280 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-f502a133-3093-44d0-9866-3cdfe37da92f tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:48.109188 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-f502a133-3093-44d0-9866-3cdfe37da92f tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:48.109696 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-f502a133-3093-44d0-9866-3cdfe37da92f tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:48.136745 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-35459493-f2d1-4dc1-b12c-6507cd06448d tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d627b760f74f48ac560e2ce2e74e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '378bb44ad89440e49f7e290a5d31004e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:47:48.153395 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-35459493-f2d1-4dc1-b12c-6507cd06448d tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] 10.222.0.30 "GET /compute/v2.1/servers/54d2f913-8385-4f34-8cb0-8c0f08c7a30f" status: 200 len: 1568 microversion: 2.1 time: 0.318522 Dec 24 10:47:48.161272 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 239/493] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:47:47 2021] GET /compute/v2.1/servers/54d2f913-8385-4f34-8cb0-8c0f08c7a30f => generated 1568 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:47:48.353219 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-f502a133-3093-44d0-9866-3cdfe37da92f tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e2194bc8c0d44b186956c1b38a0c04a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed29a38d2fe424398ac10e585a980df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:47:48.362622 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-f502a133-3093-44d0-9866-3cdfe37da92f tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] 10.222.0.30 "GET /compute/v2.1/servers/12183d8e-4c50-449a-a93d-cee72f597b3d" status: 200 len: 1359 microversion: 2.1 time: 0.285818 Dec 24 10:47:48.365876 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 255/494] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:47:48 2021] GET /compute/v2.1/servers/12183d8e-4c50-449a-a93d-cee72f597b3d => generated 1359 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 24 10:47:48.406253 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-14513eb1-060b-439d-aa93-c5e432f4699d tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:47:48.406253 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-14513eb1-060b-439d-aa93-c5e432f4699d tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] [instance: a99a6a98-4010-4f8e-a83f-fcc490f6ece0] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:47:48.406472 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-64d233eb-3f03-41ca-ac6b-71ea418ea05c tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:47:48.406848 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-64d233eb-3f03-41ca-ac6b-71ea418ea05c tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] [instance: 9330dbb8-edad-4d54-afeb-8badc464250d] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:47:48.418118 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-64d233eb-3f03-41ca-ac6b-71ea418ea05c tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:48.418595 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-64d233eb-3f03-41ca-ac6b-71ea418ea05c tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:48.419382 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-64d233eb-3f03-41ca-ac6b-71ea418ea05c tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:48.419864 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-64d233eb-3f03-41ca-ac6b-71ea418ea05c tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:48.422597 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-14513eb1-060b-439d-aa93-c5e432f4699d tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:48.423036 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-14513eb1-060b-439d-aa93-c5e432f4699d tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:48.423915 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-14513eb1-060b-439d-aa93-c5e432f4699d tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:48.424937 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-14513eb1-060b-439d-aa93-c5e432f4699d tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:48.588211 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-64d233eb-3f03-41ca-ac6b-71ea418ea05c tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] 10.222.0.30 "POST /compute/v2.1/servers/9330dbb8-edad-4d54-afeb-8badc464250d/action" status: 200 len: 37754 microversion: 2.1 time: 0.191399 Dec 24 10:47:48.592691 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 256/495] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Dec 24 10:47:48 2021] POST /compute/v2.1/servers/9330dbb8-edad-4d54-afeb-8badc464250d/action => generated 37754 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 24 10:47:48.635025 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-14513eb1-060b-439d-aa93-c5e432f4699d tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:47:48.644522 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-14513eb1-060b-439d-aa93-c5e432f4699d tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:47:48.646396 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-14513eb1-060b-439d-aa93-c5e432f4699d tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:47:48.648074 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-14513eb1-060b-439d-aa93-c5e432f4699d tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] 10.222.0.30 "GET /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0" status: 200 len: 1739 microversion: 2.20 time: 0.256747 Dec 24 10:47:48.649128 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 240/496] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Dec 24 10:47:48 2021] GET /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0 => generated 1739 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 10:47:49.186806 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-66c74b31-60c8-4f14-bab9-38b6fe019581 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:47:49.186806 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-66c74b31-60c8-4f14-bab9-38b6fe019581 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] [instance: 54d2f913-8385-4f34-8cb0-8c0f08c7a30f] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:47:49.209599 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-66c74b31-60c8-4f14-bab9-38b6fe019581 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:49.210094 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-66c74b31-60c8-4f14-bab9-38b6fe019581 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:49.210906 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-66c74b31-60c8-4f14-bab9-38b6fe019581 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:49.211393 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-66c74b31-60c8-4f14-bab9-38b6fe019581 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:49.384620 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-85cc37d1-2016-4305-9d0d-10bb3a3c2297 tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:47:49.388398 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-85cc37d1-2016-4305-9d0d-10bb3a3c2297 tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] [instance: 12183d8e-4c50-449a-a93d-cee72f597b3d] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:47:49.405878 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-85cc37d1-2016-4305-9d0d-10bb3a3c2297 tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:49.406352 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-85cc37d1-2016-4305-9d0d-10bb3a3c2297 tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:49.408421 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-85cc37d1-2016-4305-9d0d-10bb3a3c2297 tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:49.408421 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-85cc37d1-2016-4305-9d0d-10bb3a3c2297 tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:49.530040 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-66c74b31-60c8-4f14-bab9-38b6fe019581 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d627b760f74f48ac560e2ce2e74e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '378bb44ad89440e49f7e290a5d31004e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:47:49.540718 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-66c74b31-60c8-4f14-bab9-38b6fe019581 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] 10.222.0.30 "GET /compute/v2.1/servers/54d2f913-8385-4f34-8cb0-8c0f08c7a30f" status: 200 len: 1568 microversion: 2.1 time: 0.367156 Dec 24 10:47:49.545446 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 257/497] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:47:49 2021] GET /compute/v2.1/servers/54d2f913-8385-4f34-8cb0-8c0f08c7a30f => generated 1568 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:47:49.570885 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [req-433c8c55-ca37-4f87-90b4-adb2ffbfd44e req-0a6d1997-b7ff-46b3-a280-7c76b3bd5daa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "12183d8e-4c50-449a-a93d-cee72f597b3d", "name": "network-vif-plugged", "status": "completed", "tag": "abebf56e-a643-48ae-a779-897dbd105170"}]} {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:47:49.582908 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 10:47:49.582908 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: warnings.warn(msg) Dec 24 10:47:49.593954 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [req-433c8c55-ca37-4f87-90b4-adb2ffbfd44e req-0a6d1997-b7ff-46b3-a280-7c76b3bd5daa service nova] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:49.595008 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [req-433c8c55-ca37-4f87-90b4-adb2ffbfd44e req-0a6d1997-b7ff-46b3-a280-7c76b3bd5daa service nova] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:49.618253 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.compute.server_external_events [req-433c8c55-ca37-4f87-90b4-adb2ffbfd44e req-0a6d1997-b7ff-46b3-a280-7c76b3bd5daa service nova] Creating event network-vif-plugged:abebf56e-a643-48ae-a779-897dbd105170 for instance 12183d8e-4c50-449a-a93d-cee72f597b3d on hv-cinder-81644 Dec 24 10:47:49.626489 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [req-433c8c55-ca37-4f87-90b4-adb2ffbfd44e req-0a6d1997-b7ff-46b3-a280-7c76b3bd5daa service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077712 Dec 24 10:47:49.628077 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 258/498] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Dec 24 10:47:49 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 10:47:49.638161 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-4ab57bdb-d8ab-4ac7-9d9f-8e49f073c060 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:47:49.640451 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-4ab57bdb-d8ab-4ac7-9d9f-8e49f073c060 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] [instance: 9330dbb8-edad-4d54-afeb-8badc464250d] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:47:49.651259 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-4ab57bdb-d8ab-4ac7-9d9f-8e49f073c060 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:49.662954 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-4ab57bdb-d8ab-4ac7-9d9f-8e49f073c060 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:49.664169 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-4ab57bdb-d8ab-4ac7-9d9f-8e49f073c060 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:49.664790 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-4ab57bdb-d8ab-4ac7-9d9f-8e49f073c060 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:49.801307 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-4ab57bdb-d8ab-4ac7-9d9f-8e49f073c060 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] 10.222.0.30 "POST /compute/v2.1/servers/9330dbb8-edad-4d54-afeb-8badc464250d/action" status: 200 len: 38108 microversion: 2.1 time: 0.168904 Dec 24 10:47:49.803212 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 259/499] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Dec 24 10:47:49 2021] POST /compute/v2.1/servers/9330dbb8-edad-4d54-afeb-8badc464250d/action => generated 38108 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 24 10:47:49.813069 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-b5226876-f764-49c9-8d88-3c7eb0dde412 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:47:49.815316 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-b5226876-f764-49c9-8d88-3c7eb0dde412 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] [instance: a99a6a98-4010-4f8e-a83f-fcc490f6ece0] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:47:49.853386 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-b5226876-f764-49c9-8d88-3c7eb0dde412 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:49.853386 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-b5226876-f764-49c9-8d88-3c7eb0dde412 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:49.853386 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-b5226876-f764-49c9-8d88-3c7eb0dde412 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:49.853386 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-b5226876-f764-49c9-8d88-3c7eb0dde412 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:50.240340 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-85cc37d1-2016-4305-9d0d-10bb3a3c2297 tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e2194bc8c0d44b186956c1b38a0c04a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed29a38d2fe424398ac10e585a980df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:47:50.249873 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-85cc37d1-2016-4305-9d0d-10bb3a3c2297 tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] 10.222.0.30 "GET /compute/v2.1/servers/12183d8e-4c50-449a-a93d-cee72f597b3d" status: 200 len: 1359 microversion: 2.1 time: 0.871553 Dec 24 10:47:50.261926 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 241/500] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:47:49 2021] GET /compute/v2.1/servers/12183d8e-4c50-449a-a93d-cee72f597b3d => generated 1359 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:47:50.339632 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-b5226876-f764-49c9-8d88-3c7eb0dde412 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:47:50.350025 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-b5226876-f764-49c9-8d88-3c7eb0dde412 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:47:50.357609 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-b5226876-f764-49c9-8d88-3c7eb0dde412 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:47:50.363804 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-b5226876-f764-49c9-8d88-3c7eb0dde412 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] 10.222.0.30 "GET /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0" status: 200 len: 1739 microversion: 2.20 time: 0.552911 Dec 24 10:47:50.363804 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 260/501] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Dec 24 10:47:49 2021] GET /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0 => generated 1739 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 10:47:50.562541 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-67def093-0244-4cf1-a53d-407d57683ae8 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:47:50.563812 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-67def093-0244-4cf1-a53d-407d57683ae8 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] [instance: 54d2f913-8385-4f34-8cb0-8c0f08c7a30f] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:47:50.575207 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-67def093-0244-4cf1-a53d-407d57683ae8 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:50.575661 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-67def093-0244-4cf1-a53d-407d57683ae8 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:50.578607 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-67def093-0244-4cf1-a53d-407d57683ae8 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:50.583505 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-67def093-0244-4cf1-a53d-407d57683ae8 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:50.844669 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-ae58298a-f0e4-483d-accc-569998dfc4fa tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:47:50.859691 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-ae58298a-f0e4-483d-accc-569998dfc4fa tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] [instance: 9330dbb8-edad-4d54-afeb-8badc464250d] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:47:50.869887 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-ae58298a-f0e4-483d-accc-569998dfc4fa tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:50.878788 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-ae58298a-f0e4-483d-accc-569998dfc4fa tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:50.879925 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-ae58298a-f0e4-483d-accc-569998dfc4fa tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:50.880539 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-ae58298a-f0e4-483d-accc-569998dfc4fa tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:51.217221 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-ae58298a-f0e4-483d-accc-569998dfc4fa tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] 10.222.0.30 "POST /compute/v2.1/servers/9330dbb8-edad-4d54-afeb-8badc464250d/action" status: 200 len: 38108 microversion: 2.1 time: 0.202328 Dec 24 10:47:51.217221 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 261/502] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Dec 24 10:47:50 2021] POST /compute/v2.1/servers/9330dbb8-edad-4d54-afeb-8badc464250d/action => generated 38108 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 24 10:47:51.219419 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-67def093-0244-4cf1-a53d-407d57683ae8 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d627b760f74f48ac560e2ce2e74e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '378bb44ad89440e49f7e290a5d31004e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:47:51.219419 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-67def093-0244-4cf1-a53d-407d57683ae8 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] 10.222.0.30 "GET /compute/v2.1/servers/54d2f913-8385-4f34-8cb0-8c0f08c7a30f" status: 200 len: 1568 microversion: 2.1 time: 0.506187 Dec 24 10:47:51.219419 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 242/503] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:47:50 2021] GET /compute/v2.1/servers/54d2f913-8385-4f34-8cb0-8c0f08c7a30f => generated 1568 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:47:51.269478 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-de463dbe-b16a-4b5c-b63e-651012c3a842 tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:47:51.271057 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-de463dbe-b16a-4b5c-b63e-651012c3a842 tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] [instance: 12183d8e-4c50-449a-a93d-cee72f597b3d] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:47:51.279418 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-de463dbe-b16a-4b5c-b63e-651012c3a842 tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:51.279877 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-de463dbe-b16a-4b5c-b63e-651012c3a842 tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:51.280898 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-de463dbe-b16a-4b5c-b63e-651012c3a842 tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:51.281649 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-de463dbe-b16a-4b5c-b63e-651012c3a842 tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:51.382422 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-ee37d454-7817-4e7c-985a-5eaff8517154 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:47:51.423354 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-ee37d454-7817-4e7c-985a-5eaff8517154 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] [instance: a99a6a98-4010-4f8e-a83f-fcc490f6ece0] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:47:51.423354 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-ee37d454-7817-4e7c-985a-5eaff8517154 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:51.423354 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-ee37d454-7817-4e7c-985a-5eaff8517154 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:51.423354 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-ee37d454-7817-4e7c-985a-5eaff8517154 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:51.423841 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-ee37d454-7817-4e7c-985a-5eaff8517154 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:51.539657 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-de463dbe-b16a-4b5c-b63e-651012c3a842 tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e2194bc8c0d44b186956c1b38a0c04a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed29a38d2fe424398ac10e585a980df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:47:51.555107 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-de463dbe-b16a-4b5c-b63e-651012c3a842 tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] 10.222.0.30 "GET /compute/v2.1/servers/12183d8e-4c50-449a-a93d-cee72f597b3d" status: 200 len: 1359 microversion: 2.1 time: 0.292140 Dec 24 10:47:51.555714 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 262/504] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:47:51 2021] GET /compute/v2.1/servers/12183d8e-4c50-449a-a93d-cee72f597b3d => generated 1359 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:47:51.636535 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-ee37d454-7817-4e7c-985a-5eaff8517154 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:47:51.652225 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-ee37d454-7817-4e7c-985a-5eaff8517154 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:47:51.654764 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-ee37d454-7817-4e7c-985a-5eaff8517154 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:47:51.657209 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-ee37d454-7817-4e7c-985a-5eaff8517154 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] 10.222.0.30 "GET /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0" status: 200 len: 1739 microversion: 2.20 time: 0.281662 Dec 24 10:47:51.668482 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 243/505] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Dec 24 10:47:51 2021] GET /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0 => generated 1739 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 10:47:52.221898 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-c7bed521-6bd9-4534-a12f-eb34f820ef6d tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:47:52.222835 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-c7bed521-6bd9-4534-a12f-eb34f820ef6d tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] [instance: 9330dbb8-edad-4d54-afeb-8badc464250d] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:47:52.229827 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-c7bed521-6bd9-4534-a12f-eb34f820ef6d tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:52.230283 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-c7bed521-6bd9-4534-a12f-eb34f820ef6d tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:52.231079 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-c7bed521-6bd9-4534-a12f-eb34f820ef6d tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:52.231510 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-c7bed521-6bd9-4534-a12f-eb34f820ef6d tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:52.234514 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-9df0af52-1a65-4146-bc24-310aede3fb86 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:47:52.235236 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-9df0af52-1a65-4146-bc24-310aede3fb86 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] [instance: 54d2f913-8385-4f34-8cb0-8c0f08c7a30f] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:47:52.242973 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-9df0af52-1a65-4146-bc24-310aede3fb86 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:52.243741 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-9df0af52-1a65-4146-bc24-310aede3fb86 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:52.244711 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-9df0af52-1a65-4146-bc24-310aede3fb86 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:52.245422 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-9df0af52-1a65-4146-bc24-310aede3fb86 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:52.322475 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-c7bed521-6bd9-4534-a12f-eb34f820ef6d tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] 10.222.0.30 "POST /compute/v2.1/servers/9330dbb8-edad-4d54-afeb-8badc464250d/action" status: 200 len: 38239 microversion: 2.1 time: 0.103696 Dec 24 10:47:52.323628 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 263/506] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Dec 24 10:47:52 2021] POST /compute/v2.1/servers/9330dbb8-edad-4d54-afeb-8badc464250d/action => generated 38239 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 24 10:47:52.334870 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-f7cdd427-fdb8-41c3-8095-69baaa45fbc7 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:47:52.335526 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-f7cdd427-fdb8-41c3-8095-69baaa45fbc7 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] [instance: 9330dbb8-edad-4d54-afeb-8badc464250d] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:47:52.342745 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-f7cdd427-fdb8-41c3-8095-69baaa45fbc7 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:52.343268 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-f7cdd427-fdb8-41c3-8095-69baaa45fbc7 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:52.344125 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-f7cdd427-fdb8-41c3-8095-69baaa45fbc7 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:52.344633 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-f7cdd427-fdb8-41c3-8095-69baaa45fbc7 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:52.370757 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-f7cdd427-fdb8-41c3-8095-69baaa45fbc7 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] 10.222.0.30 "GET /compute/v2.1/servers/9330dbb8-edad-4d54-afeb-8badc464250d/ips" status: 200 len: 146 microversion: 2.1 time: 0.039957 Dec 24 10:47:52.371344 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 264/507] 10.222.0.30 () {58 vars in 1247 bytes} [Fri Dec 24 10:47:52 2021] GET /compute/v2.1/servers/9330dbb8-edad-4d54-afeb-8badc464250d/ips => generated 146 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 10:47:52.383470 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-9df0af52-1a65-4146-bc24-310aede3fb86 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d627b760f74f48ac560e2ce2e74e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '378bb44ad89440e49f7e290a5d31004e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:47:52.394159 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-9df0af52-1a65-4146-bc24-310aede3fb86 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] 10.222.0.30 "GET /compute/v2.1/servers/54d2f913-8385-4f34-8cb0-8c0f08c7a30f" status: 200 len: 1568 microversion: 2.1 time: 0.163558 Dec 24 10:47:52.394932 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 244/508] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:47:52 2021] GET /compute/v2.1/servers/54d2f913-8385-4f34-8cb0-8c0f08c7a30f => generated 1568 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 24 10:47:52.575568 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-30cfb0ed-3217-4ca7-95ba-9031e7bdaf0d tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:47:52.576313 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-30cfb0ed-3217-4ca7-95ba-9031e7bdaf0d tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] [instance: 12183d8e-4c50-449a-a93d-cee72f597b3d] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:47:52.583418 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-30cfb0ed-3217-4ca7-95ba-9031e7bdaf0d tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:52.584276 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-30cfb0ed-3217-4ca7-95ba-9031e7bdaf0d tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:52.586888 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-30cfb0ed-3217-4ca7-95ba-9031e7bdaf0d tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:52.588365 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-30cfb0ed-3217-4ca7-95ba-9031e7bdaf0d tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:52.681484 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-decb1e8c-90a2-4c11-a23a-7b70ed36190b tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:47:52.683609 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-decb1e8c-90a2-4c11-a23a-7b70ed36190b tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] [instance: a99a6a98-4010-4f8e-a83f-fcc490f6ece0] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:47:52.692023 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-decb1e8c-90a2-4c11-a23a-7b70ed36190b tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:52.692508 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-decb1e8c-90a2-4c11-a23a-7b70ed36190b tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:52.694091 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-decb1e8c-90a2-4c11-a23a-7b70ed36190b tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:52.694678 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-decb1e8c-90a2-4c11-a23a-7b70ed36190b tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:53.041047 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-decb1e8c-90a2-4c11-a23a-7b70ed36190b tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:47:53.050181 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-decb1e8c-90a2-4c11-a23a-7b70ed36190b tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:47:53.058340 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-decb1e8c-90a2-4c11-a23a-7b70ed36190b tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:47:53.059962 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-decb1e8c-90a2-4c11-a23a-7b70ed36190b tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] 10.222.0.30 "GET /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0" status: 200 len: 1739 microversion: 2.20 time: 0.382409 Dec 24 10:47:53.061067 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 245/509] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Dec 24 10:47:52 2021] GET /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0 => generated 1739 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 24 10:47:53.094911 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-30cfb0ed-3217-4ca7-95ba-9031e7bdaf0d tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e2194bc8c0d44b186956c1b38a0c04a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed29a38d2fe424398ac10e585a980df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:47:53.104376 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-30cfb0ed-3217-4ca7-95ba-9031e7bdaf0d tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] 10.222.0.30 "GET /compute/v2.1/servers/12183d8e-4c50-449a-a93d-cee72f597b3d" status: 200 len: 1359 microversion: 2.1 time: 0.535399 Dec 24 10:47:53.105203 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 265/510] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:47:52 2021] GET /compute/v2.1/servers/12183d8e-4c50-449a-a93d-cee72f597b3d => generated 1359 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:47:53.420555 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-12c7d432-e2cb-4fab-b536-e45f39dad99a tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:47:53.424678 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-12c7d432-e2cb-4fab-b536-e45f39dad99a tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] [instance: 54d2f913-8385-4f34-8cb0-8c0f08c7a30f] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:47:53.435558 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-12c7d432-e2cb-4fab-b536-e45f39dad99a tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:53.436271 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-12c7d432-e2cb-4fab-b536-e45f39dad99a tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:53.437334 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-12c7d432-e2cb-4fab-b536-e45f39dad99a tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:53.437928 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-12c7d432-e2cb-4fab-b536-e45f39dad99a tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:53.670176 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-12c7d432-e2cb-4fab-b536-e45f39dad99a tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d627b760f74f48ac560e2ce2e74e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '378bb44ad89440e49f7e290a5d31004e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:47:53.681856 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-12c7d432-e2cb-4fab-b536-e45f39dad99a tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] 10.222.0.30 "GET /compute/v2.1/servers/54d2f913-8385-4f34-8cb0-8c0f08c7a30f" status: 200 len: 1568 microversion: 2.1 time: 0.271291 Dec 24 10:47:53.681856 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 246/511] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:47:53 2021] GET /compute/v2.1/servers/54d2f913-8385-4f34-8cb0-8c0f08c7a30f => generated 1568 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:47:54.084979 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-d730d737-0252-4fd0-9c79-a486c50324c2 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:47:54.086172 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-d730d737-0252-4fd0-9c79-a486c50324c2 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] [instance: a99a6a98-4010-4f8e-a83f-fcc490f6ece0] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:47:54.123389 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-7161d2bb-e2d6-4b34-8b44-4e95a93b8c6a tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:47:54.124193 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-7161d2bb-e2d6-4b34-8b44-4e95a93b8c6a tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] [instance: 12183d8e-4c50-449a-a93d-cee72f597b3d] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:47:54.132220 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-d730d737-0252-4fd0-9c79-a486c50324c2 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:54.133408 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-d730d737-0252-4fd0-9c79-a486c50324c2 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:54.140439 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-d730d737-0252-4fd0-9c79-a486c50324c2 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:54.140921 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-d730d737-0252-4fd0-9c79-a486c50324c2 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:54.146004 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-7161d2bb-e2d6-4b34-8b44-4e95a93b8c6a tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:54.146450 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-7161d2bb-e2d6-4b34-8b44-4e95a93b8c6a tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:54.148792 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-7161d2bb-e2d6-4b34-8b44-4e95a93b8c6a tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:54.149281 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-7161d2bb-e2d6-4b34-8b44-4e95a93b8c6a tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:54.331634 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-7161d2bb-e2d6-4b34-8b44-4e95a93b8c6a tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e2194bc8c0d44b186956c1b38a0c04a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed29a38d2fe424398ac10e585a980df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:47:54.341056 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-7161d2bb-e2d6-4b34-8b44-4e95a93b8c6a tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] 10.222.0.30 "GET /compute/v2.1/servers/12183d8e-4c50-449a-a93d-cee72f597b3d" status: 200 len: 1548 microversion: 2.1 time: 0.220716 Dec 24 10:47:54.342090 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 247/512] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:47:54 2021] GET /compute/v2.1/servers/12183d8e-4c50-449a-a93d-cee72f597b3d => generated 1548 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:47:54.363701 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-d63c3348-5d97-4031-a965-4ad72385acd0 tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:47:54.364562 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-d63c3348-5d97-4031-a965-4ad72385acd0 tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] [instance: 12183d8e-4c50-449a-a93d-cee72f597b3d] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:47:54.383077 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-d63c3348-5d97-4031-a965-4ad72385acd0 tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:54.384219 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-d63c3348-5d97-4031-a965-4ad72385acd0 tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:54.385429 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-d63c3348-5d97-4031-a965-4ad72385acd0 tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:54.386023 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-d63c3348-5d97-4031-a965-4ad72385acd0 tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:54.466070 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-d730d737-0252-4fd0-9c79-a486c50324c2 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:47:54.475014 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-d730d737-0252-4fd0-9c79-a486c50324c2 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:47:54.477481 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-d730d737-0252-4fd0-9c79-a486c50324c2 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:47:54.479828 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-d730d737-0252-4fd0-9c79-a486c50324c2 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] 10.222.0.30 "GET /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0" status: 200 len: 1739 microversion: 2.20 time: 0.401797 Dec 24 10:47:54.490424 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 266/513] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Dec 24 10:47:54 2021] GET /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0 => generated 1739 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 10:47:54.606097 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-d63c3348-5d97-4031-a965-4ad72385acd0 tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e2194bc8c0d44b186956c1b38a0c04a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed29a38d2fe424398ac10e585a980df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:47:54.614181 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-d63c3348-5d97-4031-a965-4ad72385acd0 tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] 10.222.0.30 "GET /compute/v2.1/servers/12183d8e-4c50-449a-a93d-cee72f597b3d" status: 200 len: 1548 microversion: 2.1 time: 0.254372 Dec 24 10:47:54.625265 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 248/514] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:47:54 2021] GET /compute/v2.1/servers/12183d8e-4c50-449a-a93d-cee72f597b3d => generated 1548 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 24 10:47:54.630575 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-66658050-977d-4e27-a8a5-1eee616e1a56 tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:47:54.634546 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 10:47:54.634546 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: warnings.warn(msg) Dec 24 10:47:54.641390 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-66658050-977d-4e27-a8a5-1eee616e1a56 tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '7e2194bc8c0d44b186956c1b38a0c04a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed29a38d2fe424398ac10e585a980df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:47:54.642296 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-66658050-977d-4e27-a8a5-1eee616e1a56 tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Searching by: {'deleted': False, 'project_id': 'aed29a38d2fe424398ac10e585a980df'} {{(pid=123431) get_all /opt/stack/nova/nova/compute/api.py:2907}} Dec 24 10:47:54.650337 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-66658050-977d-4e27-a8a5-1eee616e1a56 tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:54.650780 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-66658050-977d-4e27-a8a5-1eee616e1a56 tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:54.651593 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-66658050-977d-4e27-a8a5-1eee616e1a56 tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:54.652027 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-66658050-977d-4e27-a8a5-1eee616e1a56 tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:54.725545 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-1a0cf365-29df-4eb2-962f-30ea2da6f8a1 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Action: 'create', calling method: .version_select at 0x7f189a4ab430>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-2082088977"}} {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:47:54.749688 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.quota [None req-1a0cf365-29df-4eb2-962f-30ea2da6f8a1 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Getting quotas for project 9d0fd34670674906aa9a61200251b76c. Resources: {'key_pairs'} {{(pid=123432) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 24 10:47:54.754567 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.quota [None req-1a0cf365-29df-4eb2-962f-30ea2da6f8a1 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Getting quotas for user b690a952a1704197baf5e653e27160f2 and project 9d0fd34670674906aa9a61200251b76c. Resources: {'key_pairs'} {{(pid=123432) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 24 10:47:54.777628 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.multi_cell_list [None req-66658050-977d-4e27-a8a5-1eee616e1a56 tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=123431) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Dec 24 10:47:54.893932 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-66658050-977d-4e27-a8a5-1eee616e1a56 tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] 10.222.0.30 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.267496 Dec 24 10:47:54.895053 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 249/515] 10.222.0.30 () {58 vars in 1124 bytes} [Fri Dec 24 10:47:54 2021] GET /compute/v2.1/servers => generated 343 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 24 10:47:54.899920 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-178422a7-8ad5-48cf-9bd3-c3475b316f32 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:47:54.901012 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-178422a7-8ad5-48cf-9bd3-c3475b316f32 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] [instance: 54d2f913-8385-4f34-8cb0-8c0f08c7a30f] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:47:54.908639 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-178422a7-8ad5-48cf-9bd3-c3475b316f32 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:54.909524 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-178422a7-8ad5-48cf-9bd3-c3475b316f32 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:54.910538 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-178422a7-8ad5-48cf-9bd3-c3475b316f32 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:54.911124 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-178422a7-8ad5-48cf-9bd3-c3475b316f32 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:55.155984 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-178422a7-8ad5-48cf-9bd3-c3475b316f32 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d627b760f74f48ac560e2ce2e74e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '378bb44ad89440e49f7e290a5d31004e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:47:55.172991 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-178422a7-8ad5-48cf-9bd3-c3475b316f32 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] 10.222.0.30 "GET /compute/v2.1/servers/54d2f913-8385-4f34-8cb0-8c0f08c7a30f" status: 200 len: 1568 microversion: 2.1 time: 0.276485 Dec 24 10:47:55.185590 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 250/516] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:47:54 2021] GET /compute/v2.1/servers/54d2f913-8385-4f34-8cb0-8c0f08c7a30f => generated 1568 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:47:55.198054 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-210d4f5c-1d3a-4cbe-9ef9-70b6ab218877 tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:47:55.199372 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-210d4f5c-1d3a-4cbe-9ef9-70b6ab218877 tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] [instance: 12183d8e-4c50-449a-a93d-cee72f597b3d] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:47:55.213178 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-210d4f5c-1d3a-4cbe-9ef9-70b6ab218877 tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:55.213919 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-210d4f5c-1d3a-4cbe-9ef9-70b6ab218877 tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:55.220199 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-210d4f5c-1d3a-4cbe-9ef9-70b6ab218877 tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:55.221402 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-210d4f5c-1d3a-4cbe-9ef9-70b6ab218877 tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:55.410294 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-210d4f5c-1d3a-4cbe-9ef9-70b6ab218877 tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e2194bc8c0d44b186956c1b38a0c04a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed29a38d2fe424398ac10e585a980df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:47:55.434817 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-210d4f5c-1d3a-4cbe-9ef9-70b6ab218877 tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] 10.222.0.30 "GET /compute/v2.1/servers/12183d8e-4c50-449a-a93d-cee72f597b3d" status: 200 len: 1548 microversion: 2.1 time: 0.247564 Dec 24 10:47:55.435592 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 251/517] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:47:55 2021] GET /compute/v2.1/servers/12183d8e-4c50-449a-a93d-cee72f597b3d => generated 1548 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:47:55.460858 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.quota [None req-1a0cf365-29df-4eb2-962f-30ea2da6f8a1 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Getting quotas for project 9d0fd34670674906aa9a61200251b76c. Resources: {'key_pairs'} {{(pid=123432) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 24 10:47:55.464317 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-51cc5bd6-d16c-4c27-8a6c-8fc74191412e tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c8a0e2a6-51a9-49bc-96f3-e4e9cb86b83c"}} {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:47:55.465554 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-51cc5bd6-d16c-4c27-8a6c-8fc74191412e tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] [instance: 9330dbb8-edad-4d54-afeb-8badc464250d] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:47:55.474593 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.quota [None req-1a0cf365-29df-4eb2-962f-30ea2da6f8a1 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Getting quotas for user b690a952a1704197baf5e653e27160f2 and project 9d0fd34670674906aa9a61200251b76c. Resources: {'key_pairs'} {{(pid=123432) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 24 10:47:55.484632 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-51cc5bd6-d16c-4c27-8a6c-8fc74191412e tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:55.485405 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-51cc5bd6-d16c-4c27-8a6c-8fc74191412e tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:55.493031 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-51cc5bd6-d16c-4c27-8a6c-8fc74191412e tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:55.493734 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-51cc5bd6-d16c-4c27-8a6c-8fc74191412e tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:55.494675 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-1a0cf365-29df-4eb2-962f-30ea2da6f8a1 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 2315 microversion: 2.1 time: 1.003088 Dec 24 10:47:55.495421 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 267/518] 10.222.0.30 () {60 vars in 1157 bytes} [Fri Dec 24 10:47:54 2021] POST /compute/v2.1/os-keypairs => generated 2315 bytes in 1004 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:47:55.526788 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-72b4f5c2-7a1c-41c1-b364-c91c4d22b652 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:47:55.528197 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-72b4f5c2-7a1c-41c1-b364-c91c4d22b652 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] [instance: a99a6a98-4010-4f8e-a83f-fcc490f6ece0] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:47:55.536064 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-72b4f5c2-7a1c-41c1-b364-c91c4d22b652 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:55.536521 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-72b4f5c2-7a1c-41c1-b364-c91c4d22b652 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:55.537348 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-72b4f5c2-7a1c-41c1-b364-c91c4d22b652 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:55.537778 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-72b4f5c2-7a1c-41c1-b364-c91c4d22b652 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:55.804061 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-72b4f5c2-7a1c-41c1-b364-c91c4d22b652 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:47:55.821713 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-72b4f5c2-7a1c-41c1-b364-c91c4d22b652 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:47:55.824503 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-72b4f5c2-7a1c-41c1-b364-c91c4d22b652 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:47:55.826552 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-72b4f5c2-7a1c-41c1-b364-c91c4d22b652 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] 10.222.0.30 "GET /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0" status: 200 len: 1739 microversion: 2.20 time: 0.318393 Dec 24 10:47:55.827470 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 268/519] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Dec 24 10:47:55 2021] GET /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0 => generated 1739 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 10:47:56.191546 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-3032b1d6-cbbc-49a9-aedb-3b2bdfd9dd59 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:47:56.192318 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-3032b1d6-cbbc-49a9-aedb-3b2bdfd9dd59 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] [instance: 54d2f913-8385-4f34-8cb0-8c0f08c7a30f] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:47:56.199545 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-3032b1d6-cbbc-49a9-aedb-3b2bdfd9dd59 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:56.201701 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-3032b1d6-cbbc-49a9-aedb-3b2bdfd9dd59 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:56.202870 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-3032b1d6-cbbc-49a9-aedb-3b2bdfd9dd59 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:56.203498 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-3032b1d6-cbbc-49a9-aedb-3b2bdfd9dd59 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:56.446254 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-3032b1d6-cbbc-49a9-aedb-3b2bdfd9dd59 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d627b760f74f48ac560e2ce2e74e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '378bb44ad89440e49f7e290a5d31004e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:47:56.469490 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-3032b1d6-cbbc-49a9-aedb-3b2bdfd9dd59 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] 10.222.0.30 "GET /compute/v2.1/servers/54d2f913-8385-4f34-8cb0-8c0f08c7a30f" status: 200 len: 1568 microversion: 2.1 time: 0.282418 Dec 24 10:47:56.470173 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 269/520] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:47:56 2021] GET /compute/v2.1/servers/54d2f913-8385-4f34-8cb0-8c0f08c7a30f => generated 1568 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 24 10:47:56.605315 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-51cc5bd6-d16c-4c27-8a6c-8fc74191412e tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] 10.222.0.30 "POST /compute/v2.1/servers/9330dbb8-edad-4d54-afeb-8badc464250d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.157245 Dec 24 10:47:56.606960 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 252/521] 10.222.0.30 () {60 vars in 1322 bytes} [Fri Dec 24 10:47:55 2021] POST /compute/v2.1/servers/9330dbb8-edad-4d54-afeb-8badc464250d/os-volume_attachments => generated 194 bytes in 1171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 10:47:56.729469 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-2d7e664d-2ce1-411b-8447-aaa2affa2e3b tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:47:56.730409 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-2d7e664d-2ce1-411b-8447-aaa2affa2e3b tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] [instance: d0f3b23d-c8c0-4e9a-a625-299c00fb2e27] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:47:56.738515 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-2d7e664d-2ce1-411b-8447-aaa2affa2e3b tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:56.739836 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-2d7e664d-2ce1-411b-8447-aaa2affa2e3b tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:56.743659 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-2d7e664d-2ce1-411b-8447-aaa2affa2e3b tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:56.743659 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-2d7e664d-2ce1-411b-8447-aaa2affa2e3b tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:56.846170 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-ab2379b2-7211-4037-9c09-1c1f9f845c4e tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:47:56.846872 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-ab2379b2-7211-4037-9c09-1c1f9f845c4e tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] [instance: a99a6a98-4010-4f8e-a83f-fcc490f6ece0] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:47:56.861656 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-ab2379b2-7211-4037-9c09-1c1f9f845c4e tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:56.863261 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-ab2379b2-7211-4037-9c09-1c1f9f845c4e tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:56.865606 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-ab2379b2-7211-4037-9c09-1c1f9f845c4e tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:56.868582 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-ab2379b2-7211-4037-9c09-1c1f9f845c4e tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:56.910165 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.objects.instance [None req-2d7e664d-2ce1-411b-8447-aaa2affa2e3b tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lazy-loading 'services' on Instance uuid d0f3b23d-c8c0-4e9a-a625-299c00fb2e27 {{(pid=123432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 24 10:47:57.159732 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-ab2379b2-7211-4037-9c09-1c1f9f845c4e tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:47:57.174195 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-ab2379b2-7211-4037-9c09-1c1f9f845c4e tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:47:57.177000 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-ab2379b2-7211-4037-9c09-1c1f9f845c4e tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:47:57.179052 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-ab2379b2-7211-4037-9c09-1c1f9f845c4e tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] 10.222.0.30 "GET /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0" status: 200 len: 1739 microversion: 2.20 time: 0.337382 Dec 24 10:47:57.180346 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 253/522] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Dec 24 10:47:56 2021] GET /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0 => generated 1739 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 10:47:57.261312 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-2d7e664d-2ce1-411b-8447-aaa2affa2e3b tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] 10.222.0.30 "DELETE /compute/v2.1/servers/d0f3b23d-c8c0-4e9a-a625-299c00fb2e27/os-volume_attachments/4581f73b-fab8-4ac1-b2e2-078f5ef208db" status: 202 len: 0 microversion: 2.1 time: 0.535838 Dec 24 10:47:57.262343 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 270/523] 10.222.0.30 () {58 vars in 1415 bytes} [Fri Dec 24 10:47:56 2021] DELETE /compute/v2.1/servers/d0f3b23d-c8c0-4e9a-a625-299c00fb2e27/os-volume_attachments/4581f73b-fab8-4ac1-b2e2-078f5ef208db => generated 0 bytes in 538 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Dec 24 10:47:57.274978 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-0b2c059c-8d5e-4a0a-a605-64b5d8838ac5 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:47:57.279356 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-0b2c059c-8d5e-4a0a-a605-64b5d8838ac5 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] [instance: d0f3b23d-c8c0-4e9a-a625-299c00fb2e27] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:47:57.316469 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-0b2c059c-8d5e-4a0a-a605-64b5d8838ac5 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:57.317506 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-0b2c059c-8d5e-4a0a-a605-64b5d8838ac5 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:57.318463 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-0b2c059c-8d5e-4a0a-a605-64b5d8838ac5 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:57.319079 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-0b2c059c-8d5e-4a0a-a605-64b5d8838ac5 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:57.451483 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-0b2c059c-8d5e-4a0a-a605-64b5d8838ac5 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] 10.222.0.30 "GET /compute/v2.1/servers/d0f3b23d-c8c0-4e9a-a625-299c00fb2e27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.184266 Dec 24 10:47:57.465264 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 254/524] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Dec 24 10:47:57 2021] GET /compute/v2.1/servers/d0f3b23d-c8c0-4e9a-a625-299c00fb2e27/os-volume_attachments => generated 197 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 10:47:57.495267 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-56a35d31-1df5-4052-8ac6-88204e833984 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:47:57.497358 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-56a35d31-1df5-4052-8ac6-88204e833984 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] [instance: 54d2f913-8385-4f34-8cb0-8c0f08c7a30f] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:47:57.522281 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-56a35d31-1df5-4052-8ac6-88204e833984 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:57.524328 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-56a35d31-1df5-4052-8ac6-88204e833984 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:57.529817 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-56a35d31-1df5-4052-8ac6-88204e833984 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:57.530857 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-56a35d31-1df5-4052-8ac6-88204e833984 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:57.794489 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-56a35d31-1df5-4052-8ac6-88204e833984 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d627b760f74f48ac560e2ce2e74e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '378bb44ad89440e49f7e290a5d31004e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:47:57.803293 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-56a35d31-1df5-4052-8ac6-88204e833984 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] 10.222.0.30 "GET /compute/v2.1/servers/54d2f913-8385-4f34-8cb0-8c0f08c7a30f" status: 200 len: 1568 microversion: 2.1 time: 0.318709 Dec 24 10:47:57.803955 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 271/525] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:47:57 2021] GET /compute/v2.1/servers/54d2f913-8385-4f34-8cb0-8c0f08c7a30f => generated 1568 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:47:57.910419 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-2b1d239a-e608-495c-89e1-d5847c27f0db tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "305fd416-40bf-4b2b-b6e9-df2600997549"}} {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:47:57.911502 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-2b1d239a-e608-495c-89e1-d5847c27f0db tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] [instance: 12183d8e-4c50-449a-a93d-cee72f597b3d] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:47:57.918600 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-2b1d239a-e608-495c-89e1-d5847c27f0db tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:57.919062 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-2b1d239a-e608-495c-89e1-d5847c27f0db tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:57.919860 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-2b1d239a-e608-495c-89e1-d5847c27f0db tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:57.920474 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-2b1d239a-e608-495c-89e1-d5847c27f0db tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:58.198182 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-193135ec-d2cd-4486-807c-c8fb4b24b7ce tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:47:58.198813 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-193135ec-d2cd-4486-807c-c8fb4b24b7ce tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] [instance: a99a6a98-4010-4f8e-a83f-fcc490f6ece0] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:47:58.205571 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-193135ec-d2cd-4486-807c-c8fb4b24b7ce tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:58.206128 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-193135ec-d2cd-4486-807c-c8fb4b24b7ce tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:58.206794 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-193135ec-d2cd-4486-807c-c8fb4b24b7ce tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:58.207222 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-193135ec-d2cd-4486-807c-c8fb4b24b7ce tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:58.408702 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-193135ec-d2cd-4486-807c-c8fb4b24b7ce tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:47:58.418500 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-193135ec-d2cd-4486-807c-c8fb4b24b7ce tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:47:58.419987 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-193135ec-d2cd-4486-807c-c8fb4b24b7ce tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:47:58.421187 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-193135ec-d2cd-4486-807c-c8fb4b24b7ce tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] 10.222.0.30 "GET /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0" status: 200 len: 1739 microversion: 2.20 time: 0.226767 Dec 24 10:47:58.422438 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 272/526] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Dec 24 10:47:58 2021] GET /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0 => generated 1739 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 24 10:47:58.471848 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-432e4804-94ad-4825-86dd-14223eeac219 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:47:58.473436 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-432e4804-94ad-4825-86dd-14223eeac219 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] [instance: d0f3b23d-c8c0-4e9a-a625-299c00fb2e27] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:47:58.497012 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-432e4804-94ad-4825-86dd-14223eeac219 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:58.497717 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-432e4804-94ad-4825-86dd-14223eeac219 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:58.498943 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-432e4804-94ad-4825-86dd-14223eeac219 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:58.499573 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-432e4804-94ad-4825-86dd-14223eeac219 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:58.551396 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-432e4804-94ad-4825-86dd-14223eeac219 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] 10.222.0.30 "GET /compute/v2.1/servers/d0f3b23d-c8c0-4e9a-a625-299c00fb2e27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.084595 Dec 24 10:47:58.553382 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 273/527] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Dec 24 10:47:58 2021] GET /compute/v2.1/servers/d0f3b23d-c8c0-4e9a-a625-299c00fb2e27/os-volume_attachments => generated 197 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 24 10:47:58.824688 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-89a6f2e9-8eae-4950-b933-1c0de172ce63 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:47:58.828707 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-89a6f2e9-8eae-4950-b933-1c0de172ce63 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] [instance: 54d2f913-8385-4f34-8cb0-8c0f08c7a30f] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:47:58.836878 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-89a6f2e9-8eae-4950-b933-1c0de172ce63 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:58.844316 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-89a6f2e9-8eae-4950-b933-1c0de172ce63 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:58.845796 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-89a6f2e9-8eae-4950-b933-1c0de172ce63 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:58.846249 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-89a6f2e9-8eae-4950-b933-1c0de172ce63 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:58.945289 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-2b1d239a-e608-495c-89e1-d5847c27f0db tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] 10.222.0.30 "POST /compute/v2.1/servers/12183d8e-4c50-449a-a93d-cee72f597b3d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.037287 Dec 24 10:47:58.948391 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 255/528] 10.222.0.30 () {60 vars in 1322 bytes} [Fri Dec 24 10:47:57 2021] POST /compute/v2.1/servers/12183d8e-4c50-449a-a93d-cee72f597b3d/os-volume_attachments => generated 194 bytes in 1041 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 10:47:59.073436 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-89a6f2e9-8eae-4950-b933-1c0de172ce63 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d627b760f74f48ac560e2ce2e74e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '378bb44ad89440e49f7e290a5d31004e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:47:59.084347 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-89a6f2e9-8eae-4950-b933-1c0de172ce63 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] 10.222.0.30 "GET /compute/v2.1/servers/54d2f913-8385-4f34-8cb0-8c0f08c7a30f" status: 200 len: 1568 microversion: 2.1 time: 0.265088 Dec 24 10:47:59.085557 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 274/529] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:47:58 2021] GET /compute/v2.1/servers/54d2f913-8385-4f34-8cb0-8c0f08c7a30f => generated 1568 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 24 10:47:59.442340 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-8e2fc130-8fc4-4325-9776-44dea38a4121 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:47:59.447069 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-8e2fc130-8fc4-4325-9776-44dea38a4121 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] [instance: a99a6a98-4010-4f8e-a83f-fcc490f6ece0] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:47:59.450487 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-8e2fc130-8fc4-4325-9776-44dea38a4121 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:59.451157 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-8e2fc130-8fc4-4325-9776-44dea38a4121 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:59.452116 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-8e2fc130-8fc4-4325-9776-44dea38a4121 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:59.452714 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-8e2fc130-8fc4-4325-9776-44dea38a4121 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:59.563386 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-0dc4ea2c-344c-4c71-8a16-e14dc63e6e17 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:47:59.565599 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-0dc4ea2c-344c-4c71-8a16-e14dc63e6e17 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] [instance: d0f3b23d-c8c0-4e9a-a625-299c00fb2e27] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:47:59.593738 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-0dc4ea2c-344c-4c71-8a16-e14dc63e6e17 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:59.594207 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-0dc4ea2c-344c-4c71-8a16-e14dc63e6e17 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:59.595172 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-0dc4ea2c-344c-4c71-8a16-e14dc63e6e17 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:47:59.596172 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-0dc4ea2c-344c-4c71-8a16-e14dc63e6e17 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:47:59.666580 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-0dc4ea2c-344c-4c71-8a16-e14dc63e6e17 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] 10.222.0.30 "GET /compute/v2.1/servers/d0f3b23d-c8c0-4e9a-a625-299c00fb2e27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.107122 Dec 24 10:47:59.667593 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 275/530] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Dec 24 10:47:59 2021] GET /compute/v2.1/servers/d0f3b23d-c8c0-4e9a-a625-299c00fb2e27/os-volume_attachments => generated 197 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 24 10:47:59.739999 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-8e2fc130-8fc4-4325-9776-44dea38a4121 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:47:59.758237 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-8e2fc130-8fc4-4325-9776-44dea38a4121 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:47:59.760145 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-8e2fc130-8fc4-4325-9776-44dea38a4121 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:47:59.768245 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-8e2fc130-8fc4-4325-9776-44dea38a4121 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] 10.222.0.30 "GET /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0" status: 200 len: 1739 microversion: 2.20 time: 0.326341 Dec 24 10:47:59.779687 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 256/531] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Dec 24 10:47:59 2021] GET /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0 => generated 1739 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 10:48:00.103324 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-734c2c00-559a-4a03-b2bd-e31de4a6e41c tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:48:00.104264 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-734c2c00-559a-4a03-b2bd-e31de4a6e41c tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] [instance: 54d2f913-8385-4f34-8cb0-8c0f08c7a30f] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:48:00.118329 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-734c2c00-559a-4a03-b2bd-e31de4a6e41c tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:00.119056 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-734c2c00-559a-4a03-b2bd-e31de4a6e41c tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:00.120185 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-734c2c00-559a-4a03-b2bd-e31de4a6e41c tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:00.124207 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-734c2c00-559a-4a03-b2bd-e31de4a6e41c tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:00.351821 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-734c2c00-559a-4a03-b2bd-e31de4a6e41c tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d627b760f74f48ac560e2ce2e74e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '378bb44ad89440e49f7e290a5d31004e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:48:00.359067 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-734c2c00-559a-4a03-b2bd-e31de4a6e41c tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] 10.222.0.30 "GET /compute/v2.1/servers/54d2f913-8385-4f34-8cb0-8c0f08c7a30f" status: 200 len: 1568 microversion: 2.1 time: 0.260410 Dec 24 10:48:00.364400 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 276/532] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:48:00 2021] GET /compute/v2.1/servers/54d2f913-8385-4f34-8cb0-8c0f08c7a30f => generated 1568 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:48:00.678946 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-7603619e-046a-4e67-9841-2d870cb227ed tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:48:00.679975 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-7603619e-046a-4e67-9841-2d870cb227ed tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] [instance: d0f3b23d-c8c0-4e9a-a625-299c00fb2e27] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:48:00.687294 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-7603619e-046a-4e67-9841-2d870cb227ed tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:00.687841 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-7603619e-046a-4e67-9841-2d870cb227ed tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:00.688632 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-7603619e-046a-4e67-9841-2d870cb227ed tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:00.689171 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-7603619e-046a-4e67-9841-2d870cb227ed tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:00.762054 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-7603619e-046a-4e67-9841-2d870cb227ed tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] 10.222.0.30 "GET /compute/v2.1/servers/d0f3b23d-c8c0-4e9a-a625-299c00fb2e27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.086934 Dec 24 10:48:00.763103 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 257/533] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Dec 24 10:48:00 2021] GET /compute/v2.1/servers/d0f3b23d-c8c0-4e9a-a625-299c00fb2e27/os-volume_attachments => generated 197 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 10:48:00.789329 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-2ac0e05e-6a0c-4a57-b6c0-795f5c3ec2ff tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:48:00.789953 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-2ac0e05e-6a0c-4a57-b6c0-795f5c3ec2ff tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] [instance: a99a6a98-4010-4f8e-a83f-fcc490f6ece0] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:48:00.798153 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-2ac0e05e-6a0c-4a57-b6c0-795f5c3ec2ff tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:00.798917 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-2ac0e05e-6a0c-4a57-b6c0-795f5c3ec2ff tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:00.799877 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-2ac0e05e-6a0c-4a57-b6c0-795f5c3ec2ff tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:00.800493 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-2ac0e05e-6a0c-4a57-b6c0-795f5c3ec2ff tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:01.035612 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-2ac0e05e-6a0c-4a57-b6c0-795f5c3ec2ff tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:48:01.047605 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-2ac0e05e-6a0c-4a57-b6c0-795f5c3ec2ff tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:48:01.052342 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-2ac0e05e-6a0c-4a57-b6c0-795f5c3ec2ff tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:48:01.053574 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-2ac0e05e-6a0c-4a57-b6c0-795f5c3ec2ff tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] 10.222.0.30 "GET /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0" status: 200 len: 1739 microversion: 2.20 time: 0.269200 Dec 24 10:48:01.069570 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 277/534] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Dec 24 10:48:00 2021] GET /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0 => generated 1739 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 10:48:01.381095 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-9ac8affe-0369-4da3-b9c0-6900f51701ba tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:48:01.381754 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-9ac8affe-0369-4da3-b9c0-6900f51701ba tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] [instance: 54d2f913-8385-4f34-8cb0-8c0f08c7a30f] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:48:01.388551 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-9ac8affe-0369-4da3-b9c0-6900f51701ba tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:01.389059 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-9ac8affe-0369-4da3-b9c0-6900f51701ba tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:01.390254 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-9ac8affe-0369-4da3-b9c0-6900f51701ba tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:01.391039 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-9ac8affe-0369-4da3-b9c0-6900f51701ba tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:01.572849 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-9ac8affe-0369-4da3-b9c0-6900f51701ba tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d627b760f74f48ac560e2ce2e74e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '378bb44ad89440e49f7e290a5d31004e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:48:01.584719 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-9ac8affe-0369-4da3-b9c0-6900f51701ba tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] 10.222.0.30 "GET /compute/v2.1/servers/54d2f913-8385-4f34-8cb0-8c0f08c7a30f" status: 200 len: 1568 microversion: 2.1 time: 0.207873 Dec 24 10:48:01.585724 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 258/535] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:48:01 2021] GET /compute/v2.1/servers/54d2f913-8385-4f34-8cb0-8c0f08c7a30f => generated 1568 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:48:01.777096 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-c7fb7b1d-c36a-4513-87ed-0d0fc71380a0 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:48:01.780207 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-c7fb7b1d-c36a-4513-87ed-0d0fc71380a0 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] [instance: d0f3b23d-c8c0-4e9a-a625-299c00fb2e27] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:48:01.790834 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-c7fb7b1d-c36a-4513-87ed-0d0fc71380a0 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:01.799892 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-c7fb7b1d-c36a-4513-87ed-0d0fc71380a0 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:01.799892 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-c7fb7b1d-c36a-4513-87ed-0d0fc71380a0 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:01.799892 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-c7fb7b1d-c36a-4513-87ed-0d0fc71380a0 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:01.833424 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-c7fb7b1d-c36a-4513-87ed-0d0fc71380a0 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] 10.222.0.30 "GET /compute/v2.1/servers/d0f3b23d-c8c0-4e9a-a625-299c00fb2e27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059999 Dec 24 10:48:01.833424 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 278/536] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Dec 24 10:48:01 2021] GET /compute/v2.1/servers/d0f3b23d-c8c0-4e9a-a625-299c00fb2e27/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 10:48:02.181720 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-34d46b9e-b98d-41eb-a9a3-6208cbc8ce91 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:48:02.181720 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-34d46b9e-b98d-41eb-a9a3-6208cbc8ce91 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] [instance: a99a6a98-4010-4f8e-a83f-fcc490f6ece0] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:48:02.181720 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-34d46b9e-b98d-41eb-a9a3-6208cbc8ce91 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:02.181720 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-34d46b9e-b98d-41eb-a9a3-6208cbc8ce91 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:02.185055 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-34d46b9e-b98d-41eb-a9a3-6208cbc8ce91 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:02.185055 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-34d46b9e-b98d-41eb-a9a3-6208cbc8ce91 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:02.219160 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-34d46b9e-b98d-41eb-a9a3-6208cbc8ce91 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:48:02.228676 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-34d46b9e-b98d-41eb-a9a3-6208cbc8ce91 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:48:02.230225 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-34d46b9e-b98d-41eb-a9a3-6208cbc8ce91 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:48:02.231377 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-34d46b9e-b98d-41eb-a9a3-6208cbc8ce91 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] 10.222.0.30 "GET /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0" status: 200 len: 1739 microversion: 2.20 time: 0.162612 Dec 24 10:48:02.231933 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 259/537] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Dec 24 10:48:02 2021] GET /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0 => generated 1739 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 10:48:02.603099 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-39241099-f967-453d-959f-2835051be767 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:48:02.603708 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-39241099-f967-453d-959f-2835051be767 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] [instance: 54d2f913-8385-4f34-8cb0-8c0f08c7a30f] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:48:02.609950 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-39241099-f967-453d-959f-2835051be767 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:02.610410 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-39241099-f967-453d-959f-2835051be767 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:02.611752 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-39241099-f967-453d-959f-2835051be767 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:02.612189 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-39241099-f967-453d-959f-2835051be767 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:02.751922 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-39241099-f967-453d-959f-2835051be767 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d627b760f74f48ac560e2ce2e74e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '378bb44ad89440e49f7e290a5d31004e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:48:02.764214 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-39241099-f967-453d-959f-2835051be767 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] 10.222.0.30 "GET /compute/v2.1/servers/54d2f913-8385-4f34-8cb0-8c0f08c7a30f" status: 200 len: 1568 microversion: 2.1 time: 0.165082 Dec 24 10:48:02.764863 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 279/538] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:48:02 2021] GET /compute/v2.1/servers/54d2f913-8385-4f34-8cb0-8c0f08c7a30f => generated 1568 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:48:02.845103 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-676a155f-cb90-44d6-81d0-e7516128544b tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:48:02.846743 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-676a155f-cb90-44d6-81d0-e7516128544b tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] [instance: d0f3b23d-c8c0-4e9a-a625-299c00fb2e27] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:48:02.852680 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-676a155f-cb90-44d6-81d0-e7516128544b tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:02.853172 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-676a155f-cb90-44d6-81d0-e7516128544b tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:02.853951 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-676a155f-cb90-44d6-81d0-e7516128544b tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:02.854384 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-676a155f-cb90-44d6-81d0-e7516128544b tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:02.882546 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-676a155f-cb90-44d6-81d0-e7516128544b tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] 10.222.0.30 "GET /compute/v2.1/servers/d0f3b23d-c8c0-4e9a-a625-299c00fb2e27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041322 Dec 24 10:48:02.883118 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 260/539] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Dec 24 10:48:02 2021] GET /compute/v2.1/servers/d0f3b23d-c8c0-4e9a-a625-299c00fb2e27/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 10:48:03.256839 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-205cc79f-fe99-4828-b63b-59f73a11aaec tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:48:03.257436 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-205cc79f-fe99-4828-b63b-59f73a11aaec tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] [instance: a99a6a98-4010-4f8e-a83f-fcc490f6ece0] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:48:03.263815 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-205cc79f-fe99-4828-b63b-59f73a11aaec tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:03.264263 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-205cc79f-fe99-4828-b63b-59f73a11aaec tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:03.265086 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-205cc79f-fe99-4828-b63b-59f73a11aaec tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:03.265531 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-205cc79f-fe99-4828-b63b-59f73a11aaec tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:03.459060 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-205cc79f-fe99-4828-b63b-59f73a11aaec tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:48:03.468433 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-205cc79f-fe99-4828-b63b-59f73a11aaec tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:48:03.470849 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-205cc79f-fe99-4828-b63b-59f73a11aaec tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:48:03.472157 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-205cc79f-fe99-4828-b63b-59f73a11aaec tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] 10.222.0.30 "GET /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0" status: 200 len: 1739 microversion: 2.20 time: 0.218945 Dec 24 10:48:03.473309 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 280/540] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Dec 24 10:48:03 2021] GET /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0 => generated 1739 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 10:48:03.782444 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-4a39f925-29db-4a7b-b4e7-c99bacb16715 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:48:03.782986 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-4a39f925-29db-4a7b-b4e7-c99bacb16715 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] [instance: 54d2f913-8385-4f34-8cb0-8c0f08c7a30f] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:48:03.789249 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-4a39f925-29db-4a7b-b4e7-c99bacb16715 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:03.789690 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-4a39f925-29db-4a7b-b4e7-c99bacb16715 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:03.790462 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-4a39f925-29db-4a7b-b4e7-c99bacb16715 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:03.790898 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-4a39f925-29db-4a7b-b4e7-c99bacb16715 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:03.893718 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-24ee2cc8-c317-42cb-860b-e607f9f75b7f tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:48:03.894614 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-24ee2cc8-c317-42cb-860b-e607f9f75b7f tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] [instance: d0f3b23d-c8c0-4e9a-a625-299c00fb2e27] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:48:03.900625 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-24ee2cc8-c317-42cb-860b-e607f9f75b7f tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:03.901671 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-24ee2cc8-c317-42cb-860b-e607f9f75b7f tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:03.901936 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-24ee2cc8-c317-42cb-860b-e607f9f75b7f tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:03.902276 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-24ee2cc8-c317-42cb-860b-e607f9f75b7f tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:03.936268 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-4a39f925-29db-4a7b-b4e7-c99bacb16715 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d627b760f74f48ac560e2ce2e74e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '378bb44ad89440e49f7e290a5d31004e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:48:03.936857 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-24ee2cc8-c317-42cb-860b-e607f9f75b7f tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] 10.222.0.30 "GET /compute/v2.1/servers/d0f3b23d-c8c0-4e9a-a625-299c00fb2e27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045469 Dec 24 10:48:03.936857 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 281/541] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Dec 24 10:48:03 2021] GET /compute/v2.1/servers/d0f3b23d-c8c0-4e9a-a625-299c00fb2e27/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 24 10:48:03.944691 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-4a39f925-29db-4a7b-b4e7-c99bacb16715 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] 10.222.0.30 "GET /compute/v2.1/servers/54d2f913-8385-4f34-8cb0-8c0f08c7a30f" status: 200 len: 1568 microversion: 2.1 time: 0.165968 Dec 24 10:48:03.945316 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 261/542] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:48:03 2021] GET /compute/v2.1/servers/54d2f913-8385-4f34-8cb0-8c0f08c7a30f => generated 1568 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:48:04.490989 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-1a6deed1-ae71-4494-8c0c-74ef948dcb8d tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:48:04.491570 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-1a6deed1-ae71-4494-8c0c-74ef948dcb8d tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] [instance: a99a6a98-4010-4f8e-a83f-fcc490f6ece0] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:48:04.497826 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-1a6deed1-ae71-4494-8c0c-74ef948dcb8d tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:04.498275 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-1a6deed1-ae71-4494-8c0c-74ef948dcb8d tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:04.499080 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-1a6deed1-ae71-4494-8c0c-74ef948dcb8d tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:04.499511 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-1a6deed1-ae71-4494-8c0c-74ef948dcb8d tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:04.634253 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-1a6deed1-ae71-4494-8c0c-74ef948dcb8d tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:48:04.644650 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-1a6deed1-ae71-4494-8c0c-74ef948dcb8d tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:48:04.646216 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-1a6deed1-ae71-4494-8c0c-74ef948dcb8d tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:48:04.647623 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-1a6deed1-ae71-4494-8c0c-74ef948dcb8d tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] 10.222.0.30 "GET /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0" status: 200 len: 1739 microversion: 2.20 time: 0.160309 Dec 24 10:48:04.648215 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 282/543] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Dec 24 10:48:04 2021] GET /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0 => generated 1739 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 10:48:04.948080 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-9535c2b2-b389-4e19-b651-66de68e19882 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:48:04.949026 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-9535c2b2-b389-4e19-b651-66de68e19882 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] [instance: d0f3b23d-c8c0-4e9a-a625-299c00fb2e27] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:48:04.956042 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-9535c2b2-b389-4e19-b651-66de68e19882 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:04.956953 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-9535c2b2-b389-4e19-b651-66de68e19882 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:04.958418 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-9535c2b2-b389-4e19-b651-66de68e19882 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:04.959130 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-9535c2b2-b389-4e19-b651-66de68e19882 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:04.962126 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-0e3645ac-068a-41e7-955b-a48628d604b0 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:48:04.962696 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-0e3645ac-068a-41e7-955b-a48628d604b0 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] [instance: 54d2f913-8385-4f34-8cb0-8c0f08c7a30f] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:48:04.970466 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-0e3645ac-068a-41e7-955b-a48628d604b0 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:04.971538 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-0e3645ac-068a-41e7-955b-a48628d604b0 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:04.972660 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-0e3645ac-068a-41e7-955b-a48628d604b0 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:04.982522 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-0e3645ac-068a-41e7-955b-a48628d604b0 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:04.994972 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-9535c2b2-b389-4e19-b651-66de68e19882 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] 10.222.0.30 "GET /compute/v2.1/servers/d0f3b23d-c8c0-4e9a-a625-299c00fb2e27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050606 Dec 24 10:48:04.995550 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 262/544] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Dec 24 10:48:04 2021] GET /compute/v2.1/servers/d0f3b23d-c8c0-4e9a-a625-299c00fb2e27/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 24 10:48:05.228835 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-0e3645ac-068a-41e7-955b-a48628d604b0 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d627b760f74f48ac560e2ce2e74e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '378bb44ad89440e49f7e290a5d31004e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:48:05.237853 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-0e3645ac-068a-41e7-955b-a48628d604b0 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] 10.222.0.30 "GET /compute/v2.1/servers/54d2f913-8385-4f34-8cb0-8c0f08c7a30f" status: 200 len: 1568 microversion: 2.1 time: 0.279746 Dec 24 10:48:05.238420 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 283/545] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:48:04 2021] GET /compute/v2.1/servers/54d2f913-8385-4f34-8cb0-8c0f08c7a30f => generated 1568 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:48:05.422510 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-301be68f-efa2-4dde-92ee-d65b7064fb4c tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:48:05.428577 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-301be68f-efa2-4dde-92ee-d65b7064fb4c tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:05.429140 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-301be68f-efa2-4dde-92ee-d65b7064fb4c tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:05.490453 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-301be68f-efa2-4dde-92ee-d65b7064fb4c tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] [instance: 9330dbb8-edad-4d54-afeb-8badc464250d] Going to try to stop instance {{(pid=123431) force_stop /opt/stack/nova/nova/compute/api.py:2654}} Dec 24 10:48:05.669364 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-4efd9954-25ee-4103-80c3-5a24c0b1f1f2 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:48:05.669988 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-4efd9954-25ee-4103-80c3-5a24c0b1f1f2 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] [instance: a99a6a98-4010-4f8e-a83f-fcc490f6ece0] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:48:05.676542 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-4efd9954-25ee-4103-80c3-5a24c0b1f1f2 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:05.677082 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-4efd9954-25ee-4103-80c3-5a24c0b1f1f2 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:05.677854 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-4efd9954-25ee-4103-80c3-5a24c0b1f1f2 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:05.678643 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-4efd9954-25ee-4103-80c3-5a24c0b1f1f2 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:05.682266 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-301be68f-efa2-4dde-92ee-d65b7064fb4c tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] 10.222.0.30 "POST /compute/v2.1/servers/9330dbb8-edad-4d54-afeb-8badc464250d/action" status: 202 len: 0 microversion: 2.1 time: 0.263285 Dec 24 10:48:05.685159 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 263/546] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Dec 24 10:48:05 2021] POST /compute/v2.1/servers/9330dbb8-edad-4d54-afeb-8badc464250d/action => generated 0 bytes in 265 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 24 10:48:05.691729 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-c97af4e3-e278-4914-99bd-72b91925a5dd tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:48:05.692565 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-c97af4e3-e278-4914-99bd-72b91925a5dd tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] [instance: 9330dbb8-edad-4d54-afeb-8badc464250d] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:48:05.709254 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-c97af4e3-e278-4914-99bd-72b91925a5dd tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:05.709710 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-c97af4e3-e278-4914-99bd-72b91925a5dd tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:05.710537 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-c97af4e3-e278-4914-99bd-72b91925a5dd tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:05.710972 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-c97af4e3-e278-4914-99bd-72b91925a5dd tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:05.826101 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-4efd9954-25ee-4103-80c3-5a24c0b1f1f2 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:48:05.845846 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-4efd9954-25ee-4103-80c3-5a24c0b1f1f2 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:48:05.845846 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-4efd9954-25ee-4103-80c3-5a24c0b1f1f2 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:48:05.845846 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-4efd9954-25ee-4103-80c3-5a24c0b1f1f2 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] 10.222.0.30 "GET /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0" status: 200 len: 1721 microversion: 2.20 time: 0.178081 Dec 24 10:48:05.846248 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 284/547] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Dec 24 10:48:05 2021] GET /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0 => generated 1721 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 24 10:48:05.851114 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-c97af4e3-e278-4914-99bd-72b91925a5dd tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37516225f9244c969ed168f6a024482a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0115a5cc8b4b1e8bffb84e0f3e0b08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:48:05.859130 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-c97af4e3-e278-4914-99bd-72b91925a5dd tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] 10.222.0.30 "GET /compute/v2.1/servers/9330dbb8-edad-4d54-afeb-8badc464250d" status: 200 len: 1724 microversion: 2.1 time: 0.171818 Dec 24 10:48:05.859692 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 264/548] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:48:05 2021] GET /compute/v2.1/servers/9330dbb8-edad-4d54-afeb-8badc464250d => generated 1724 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 24 10:48:06.008393 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-f39def2f-fd77-4441-b031-a0279019d4b5 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:48:06.009313 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-f39def2f-fd77-4441-b031-a0279019d4b5 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] [instance: d0f3b23d-c8c0-4e9a-a625-299c00fb2e27] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:48:06.015135 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-f39def2f-fd77-4441-b031-a0279019d4b5 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:06.015580 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-f39def2f-fd77-4441-b031-a0279019d4b5 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:06.016351 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-f39def2f-fd77-4441-b031-a0279019d4b5 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:06.016784 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-f39def2f-fd77-4441-b031-a0279019d4b5 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:06.045003 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-f39def2f-fd77-4441-b031-a0279019d4b5 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] 10.222.0.30 "GET /compute/v2.1/servers/d0f3b23d-c8c0-4e9a-a625-299c00fb2e27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040444 Dec 24 10:48:06.045562 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 285/549] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Dec 24 10:48:06 2021] GET /compute/v2.1/servers/d0f3b23d-c8c0-4e9a-a625-299c00fb2e27/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 10:48:06.253871 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-ba275574-d714-44d5-9122-8316055600b9 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:48:06.267728 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-ba275574-d714-44d5-9122-8316055600b9 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] [instance: 54d2f913-8385-4f34-8cb0-8c0f08c7a30f] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:48:06.267728 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-ba275574-d714-44d5-9122-8316055600b9 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:06.267728 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-ba275574-d714-44d5-9122-8316055600b9 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:06.267728 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-ba275574-d714-44d5-9122-8316055600b9 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:06.268147 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-ba275574-d714-44d5-9122-8316055600b9 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:06.398653 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-ba275574-d714-44d5-9122-8316055600b9 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d627b760f74f48ac560e2ce2e74e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '378bb44ad89440e49f7e290a5d31004e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:48:06.406576 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-ba275574-d714-44d5-9122-8316055600b9 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] 10.222.0.30 "GET /compute/v2.1/servers/54d2f913-8385-4f34-8cb0-8c0f08c7a30f" status: 200 len: 1568 microversion: 2.1 time: 0.156391 Dec 24 10:48:06.407147 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 265/550] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:48:06 2021] GET /compute/v2.1/servers/54d2f913-8385-4f34-8cb0-8c0f08c7a30f => generated 1568 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:48:06.864956 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-73e5b658-0bc7-42c7-a8ef-9b6c585bbab8 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:48:06.864956 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-73e5b658-0bc7-42c7-a8ef-9b6c585bbab8 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] [instance: a99a6a98-4010-4f8e-a83f-fcc490f6ece0] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:48:06.868095 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-73e5b658-0bc7-42c7-a8ef-9b6c585bbab8 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:06.868542 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-73e5b658-0bc7-42c7-a8ef-9b6c585bbab8 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:06.869352 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-73e5b658-0bc7-42c7-a8ef-9b6c585bbab8 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:06.869785 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-73e5b658-0bc7-42c7-a8ef-9b6c585bbab8 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:06.878108 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-c38bc62d-7c0f-4734-a0d0-9bdd15935b0d tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:48:06.878948 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-c38bc62d-7c0f-4734-a0d0-9bdd15935b0d tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] [instance: 9330dbb8-edad-4d54-afeb-8badc464250d] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:48:06.888868 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-c38bc62d-7c0f-4734-a0d0-9bdd15935b0d tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:06.888868 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-c38bc62d-7c0f-4734-a0d0-9bdd15935b0d tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:06.888868 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-c38bc62d-7c0f-4734-a0d0-9bdd15935b0d tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:06.888868 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-c38bc62d-7c0f-4734-a0d0-9bdd15935b0d tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:07.023905 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-c38bc62d-7c0f-4734-a0d0-9bdd15935b0d tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37516225f9244c969ed168f6a024482a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0115a5cc8b4b1e8bffb84e0f3e0b08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:48:07.031602 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-c38bc62d-7c0f-4734-a0d0-9bdd15935b0d tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] 10.222.0.30 "GET /compute/v2.1/servers/9330dbb8-edad-4d54-afeb-8badc464250d" status: 200 len: 1724 microversion: 2.1 time: 0.158518 Dec 24 10:48:07.032181 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 266/551] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:48:06 2021] GET /compute/v2.1/servers/9330dbb8-edad-4d54-afeb-8badc464250d => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 24 10:48:07.052958 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-73e5b658-0bc7-42c7-a8ef-9b6c585bbab8 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:48:07.056781 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-6828add7-df6d-4ad5-80a4-a140a943f136 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:48:07.057821 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-6828add7-df6d-4ad5-80a4-a140a943f136 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] [instance: d0f3b23d-c8c0-4e9a-a625-299c00fb2e27] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:48:07.060746 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-73e5b658-0bc7-42c7-a8ef-9b6c585bbab8 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:48:07.062303 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-73e5b658-0bc7-42c7-a8ef-9b6c585bbab8 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:48:07.063448 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-73e5b658-0bc7-42c7-a8ef-9b6c585bbab8 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] 10.222.0.30 "GET /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0" status: 200 len: 1721 microversion: 2.20 time: 0.206156 Dec 24 10:48:07.064539 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 286/552] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Dec 24 10:48:06 2021] GET /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0 => generated 1721 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 10:48:07.065239 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-6828add7-df6d-4ad5-80a4-a140a943f136 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:07.069562 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-6828add7-df6d-4ad5-80a4-a140a943f136 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:07.069562 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-6828add7-df6d-4ad5-80a4-a140a943f136 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:07.069562 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-6828add7-df6d-4ad5-80a4-a140a943f136 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:07.098214 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-6828add7-df6d-4ad5-80a4-a140a943f136 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] 10.222.0.30 "GET /compute/v2.1/servers/d0f3b23d-c8c0-4e9a-a625-299c00fb2e27/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045040 Dec 24 10:48:07.098742 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 267/553] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Dec 24 10:48:07 2021] GET /compute/v2.1/servers/d0f3b23d-c8c0-4e9a-a625-299c00fb2e27/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Dec 24 10:48:07.218455 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [req-1ff52bc0-b80f-4324-b290-e37a84319ef7 req-31c80276-1fe3-471f-926e-dd0cbb50e470 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a99a6a98-4010-4f8e-a83f-fcc490f6ece0", "name": "network-vif-unplugged", "status": "completed", "tag": "e50dfc57-62cb-4d13-9e17-f48edcdb1dcc"}]} {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:48:07.220141 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 10:48:07.220141 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: warnings.warn(msg) Dec 24 10:48:07.227724 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [req-1ff52bc0-b80f-4324-b290-e37a84319ef7 req-31c80276-1fe3-471f-926e-dd0cbb50e470 service nova] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:07.228159 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [req-1ff52bc0-b80f-4324-b290-e37a84319ef7 req-31c80276-1fe3-471f-926e-dd0cbb50e470 service nova] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:07.239372 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.compute.server_external_events [req-1ff52bc0-b80f-4324-b290-e37a84319ef7 req-31c80276-1fe3-471f-926e-dd0cbb50e470 service nova] Creating event network-vif-unplugged:e50dfc57-62cb-4d13-9e17-f48edcdb1dcc for instance a99a6a98-4010-4f8e-a83f-fcc490f6ece0 on hv-cinder-81644 Dec 24 10:48:07.244916 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [req-1ff52bc0-b80f-4324-b290-e37a84319ef7 req-31c80276-1fe3-471f-926e-dd0cbb50e470 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.029944 Dec 24 10:48:07.246127 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 287/554] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Dec 24 10:48:07 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 10:48:07.423358 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-6bc52bf7-a1af-4f04-8d06-50c5cbe3cc35 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:48:07.423966 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-6bc52bf7-a1af-4f04-8d06-50c5cbe3cc35 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] [instance: 54d2f913-8385-4f34-8cb0-8c0f08c7a30f] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:48:07.430605 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-6bc52bf7-a1af-4f04-8d06-50c5cbe3cc35 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:07.431059 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-6bc52bf7-a1af-4f04-8d06-50c5cbe3cc35 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:07.431841 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-6bc52bf7-a1af-4f04-8d06-50c5cbe3cc35 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:07.432273 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-6bc52bf7-a1af-4f04-8d06-50c5cbe3cc35 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:07.570067 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-6bc52bf7-a1af-4f04-8d06-50c5cbe3cc35 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d627b760f74f48ac560e2ce2e74e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '378bb44ad89440e49f7e290a5d31004e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:48:07.577782 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-6bc52bf7-a1af-4f04-8d06-50c5cbe3cc35 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] 10.222.0.30 "GET /compute/v2.1/servers/54d2f913-8385-4f34-8cb0-8c0f08c7a30f" status: 200 len: 1568 microversion: 2.1 time: 0.158030 Dec 24 10:48:07.578348 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 268/555] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:48:07 2021] GET /compute/v2.1/servers/54d2f913-8385-4f34-8cb0-8c0f08c7a30f => generated 1568 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:48:08.049621 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-71ee5670-bf95-48fe-bef9-4ae3dc8ca600 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:48:08.050342 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-71ee5670-bf95-48fe-bef9-4ae3dc8ca600 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] [instance: 9330dbb8-edad-4d54-afeb-8badc464250d] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:48:08.056740 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-71ee5670-bf95-48fe-bef9-4ae3dc8ca600 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:08.057245 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-71ee5670-bf95-48fe-bef9-4ae3dc8ca600 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:08.058026 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-71ee5670-bf95-48fe-bef9-4ae3dc8ca600 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:08.058465 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-71ee5670-bf95-48fe-bef9-4ae3dc8ca600 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:08.082501 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-9114319d-0eb6-4de7-af8f-a67660523cd1 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:48:08.083184 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-9114319d-0eb6-4de7-af8f-a67660523cd1 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] [instance: a99a6a98-4010-4f8e-a83f-fcc490f6ece0] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:48:08.089273 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-9114319d-0eb6-4de7-af8f-a67660523cd1 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:08.089728 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-9114319d-0eb6-4de7-af8f-a67660523cd1 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:08.090509 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-9114319d-0eb6-4de7-af8f-a67660523cd1 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:08.090935 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-9114319d-0eb6-4de7-af8f-a67660523cd1 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:08.228057 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-71ee5670-bf95-48fe-bef9-4ae3dc8ca600 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37516225f9244c969ed168f6a024482a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0115a5cc8b4b1e8bffb84e0f3e0b08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:48:08.242340 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-9114319d-0eb6-4de7-af8f-a67660523cd1 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:48:08.242659 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-71ee5670-bf95-48fe-bef9-4ae3dc8ca600 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] 10.222.0.30 "GET /compute/v2.1/servers/9330dbb8-edad-4d54-afeb-8badc464250d" status: 200 len: 1724 microversion: 2.1 time: 0.194180 Dec 24 10:48:08.243250 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 288/556] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:48:08 2021] GET /compute/v2.1/servers/9330dbb8-edad-4d54-afeb-8badc464250d => generated 1724 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:48:08.266746 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-9114319d-0eb6-4de7-af8f-a67660523cd1 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:48:08.268391 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-9114319d-0eb6-4de7-af8f-a67660523cd1 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:48:08.270537 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-9114319d-0eb6-4de7-af8f-a67660523cd1 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] 10.222.0.30 "GET /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0" status: 200 len: 1721 microversion: 2.20 time: 0.191258 Dec 24 10:48:08.271203 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 269/557] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Dec 24 10:48:08 2021] GET /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0 => generated 1721 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 24 10:48:08.516492 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-b5c532a0-d360-4aed-96ec-9e122985b5d7 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:48:08.517121 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-b5c532a0-d360-4aed-96ec-9e122985b5d7 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] [instance: d0f3b23d-c8c0-4e9a-a625-299c00fb2e27] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:48:08.524348 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-b5c532a0-d360-4aed-96ec-9e122985b5d7 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:08.524953 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-b5c532a0-d360-4aed-96ec-9e122985b5d7 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:08.525807 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-b5c532a0-d360-4aed-96ec-9e122985b5d7 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:08.526314 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-b5c532a0-d360-4aed-96ec-9e122985b5d7 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:08.551628 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-b5c532a0-d360-4aed-96ec-9e122985b5d7 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] [instance: d0f3b23d-c8c0-4e9a-a625-299c00fb2e27] Going to try to terminate instance {{(pid=123432) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 24 10:48:08.595943 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-f6206ce9-a68c-4a96-a4e3-fbf547e41ac1 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:48:08.596562 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-f6206ce9-a68c-4a96-a4e3-fbf547e41ac1 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] [instance: 54d2f913-8385-4f34-8cb0-8c0f08c7a30f] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:48:08.602789 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-f6206ce9-a68c-4a96-a4e3-fbf547e41ac1 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:08.603228 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-f6206ce9-a68c-4a96-a4e3-fbf547e41ac1 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:08.603997 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-f6206ce9-a68c-4a96-a4e3-fbf547e41ac1 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:08.604428 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-f6206ce9-a68c-4a96-a4e3-fbf547e41ac1 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:08.753997 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-f6206ce9-a68c-4a96-a4e3-fbf547e41ac1 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d627b760f74f48ac560e2ce2e74e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '378bb44ad89440e49f7e290a5d31004e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:48:08.761866 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-f6206ce9-a68c-4a96-a4e3-fbf547e41ac1 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] 10.222.0.30 "GET /compute/v2.1/servers/54d2f913-8385-4f34-8cb0-8c0f08c7a30f" status: 200 len: 1568 microversion: 2.1 time: 0.170044 Dec 24 10:48:08.762824 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 270/558] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:48:08 2021] GET /compute/v2.1/servers/54d2f913-8385-4f34-8cb0-8c0f08c7a30f => generated 1568 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:48:08.891483 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-b5c532a0-d360-4aed-96ec-9e122985b5d7 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] 10.222.0.30 "DELETE /compute/v2.1/servers/d0f3b23d-c8c0-4e9a-a625-299c00fb2e27" status: 204 len: 0 microversion: 2.1 time: 0.377478 Dec 24 10:48:08.891483 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 289/559] 10.222.0.30 () {58 vars in 1238 bytes} [Fri Dec 24 10:48:08 2021] DELETE /compute/v2.1/servers/d0f3b23d-c8c0-4e9a-a625-299c00fb2e27 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 24 10:48:08.899538 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-0b0fb076-8281-4f70-acf2-2a3593ab7d7f tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:48:08.903122 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-0b0fb076-8281-4f70-acf2-2a3593ab7d7f tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] [instance: d0f3b23d-c8c0-4e9a-a625-299c00fb2e27] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:48:08.909936 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-0b0fb076-8281-4f70-acf2-2a3593ab7d7f tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:08.910617 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-0b0fb076-8281-4f70-acf2-2a3593ab7d7f tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:08.911408 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-0b0fb076-8281-4f70-acf2-2a3593ab7d7f tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:08.911835 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-0b0fb076-8281-4f70-acf2-2a3593ab7d7f tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:09.043954 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-0b0fb076-8281-4f70-acf2-2a3593ab7d7f tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ad5096717dc425c849dfe95ea55a6af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62d11172cdf4959a15ac1ffc5601aca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:48:09.051259 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-0b0fb076-8281-4f70-acf2-2a3593ab7d7f tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] 10.222.0.30 "GET /compute/v2.1/servers/d0f3b23d-c8c0-4e9a-a625-299c00fb2e27" status: 200 len: 1513 microversion: 2.1 time: 0.155692 Dec 24 10:48:09.051907 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 271/560] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:48:08 2021] GET /compute/v2.1/servers/d0f3b23d-c8c0-4e9a-a625-299c00fb2e27 => generated 1513 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:48:09.260647 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-7908f516-936f-41fd-a44b-e8f0a3220fb8 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:48:09.261380 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-7908f516-936f-41fd-a44b-e8f0a3220fb8 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] [instance: 9330dbb8-edad-4d54-afeb-8badc464250d] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:48:09.268283 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-7908f516-936f-41fd-a44b-e8f0a3220fb8 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:09.268743 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-7908f516-936f-41fd-a44b-e8f0a3220fb8 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:09.273017 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-7908f516-936f-41fd-a44b-e8f0a3220fb8 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:09.273017 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-7908f516-936f-41fd-a44b-e8f0a3220fb8 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:09.288786 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-2906f1c7-7676-4b30-b8d8-3d0e47604208 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:48:09.289649 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-2906f1c7-7676-4b30-b8d8-3d0e47604208 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] [instance: a99a6a98-4010-4f8e-a83f-fcc490f6ece0] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:48:09.295733 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-2906f1c7-7676-4b30-b8d8-3d0e47604208 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:09.296245 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-2906f1c7-7676-4b30-b8d8-3d0e47604208 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:09.297047 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-2906f1c7-7676-4b30-b8d8-3d0e47604208 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:09.297476 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-2906f1c7-7676-4b30-b8d8-3d0e47604208 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:09.402780 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-7908f516-936f-41fd-a44b-e8f0a3220fb8 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37516225f9244c969ed168f6a024482a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0115a5cc8b4b1e8bffb84e0f3e0b08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:48:09.411007 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-7908f516-936f-41fd-a44b-e8f0a3220fb8 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] 10.222.0.30 "GET /compute/v2.1/servers/9330dbb8-edad-4d54-afeb-8badc464250d" status: 200 len: 1724 microversion: 2.1 time: 0.154490 Dec 24 10:48:09.411655 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 290/561] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:48:09 2021] GET /compute/v2.1/servers/9330dbb8-edad-4d54-afeb-8badc464250d => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:48:09.432976 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-2906f1c7-7676-4b30-b8d8-3d0e47604208 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:48:09.441547 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-2906f1c7-7676-4b30-b8d8-3d0e47604208 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:48:09.443037 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-2906f1c7-7676-4b30-b8d8-3d0e47604208 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:48:09.444174 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-2906f1c7-7676-4b30-b8d8-3d0e47604208 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] 10.222.0.30 "GET /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0" status: 200 len: 1664 microversion: 2.20 time: 0.159048 Dec 24 10:48:09.444769 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 272/562] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Dec 24 10:48:09 2021] GET /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0 => generated 1664 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 24 10:48:09.461474 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-a65fdd44-7530-4ba7-9eed-51c08b25fc46 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6c87b2d9-7ced-4611-89ff-9ca851a392f0"}} {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:48:09.462599 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-a65fdd44-7530-4ba7-9eed-51c08b25fc46 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] [instance: a99a6a98-4010-4f8e-a83f-fcc490f6ece0] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:48:09.468528 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-a65fdd44-7530-4ba7-9eed-51c08b25fc46 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:09.469013 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-a65fdd44-7530-4ba7-9eed-51c08b25fc46 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:09.469794 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-a65fdd44-7530-4ba7-9eed-51c08b25fc46 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:09.470226 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-a65fdd44-7530-4ba7-9eed-51c08b25fc46 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:09.779450 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-b6014254-abd3-433b-a80e-56a529c413b9 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:48:09.779982 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-b6014254-abd3-433b-a80e-56a529c413b9 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] [instance: 54d2f913-8385-4f34-8cb0-8c0f08c7a30f] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:48:09.786705 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-b6014254-abd3-433b-a80e-56a529c413b9 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:09.787145 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-b6014254-abd3-433b-a80e-56a529c413b9 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:09.787913 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-b6014254-abd3-433b-a80e-56a529c413b9 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:09.788340 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-b6014254-abd3-433b-a80e-56a529c413b9 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:09.918887 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-b6014254-abd3-433b-a80e-56a529c413b9 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d627b760f74f48ac560e2ce2e74e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '378bb44ad89440e49f7e290a5d31004e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:48:09.926570 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-b6014254-abd3-433b-a80e-56a529c413b9 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] 10.222.0.30 "GET /compute/v2.1/servers/54d2f913-8385-4f34-8cb0-8c0f08c7a30f" status: 200 len: 1548 microversion: 2.1 time: 0.150853 Dec 24 10:48:09.927132 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 273/563] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:48:09 2021] GET /compute/v2.1/servers/54d2f913-8385-4f34-8cb0-8c0f08c7a30f => generated 1548 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 24 10:48:09.943234 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-7f7a9493-5c80-4293-a4ec-1e433017387a tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:48:09.943719 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-7f7a9493-5c80-4293-a4ec-1e433017387a tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] [instance: 54d2f913-8385-4f34-8cb0-8c0f08c7a30f] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:48:09.949391 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-7f7a9493-5c80-4293-a4ec-1e433017387a tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:09.949842 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-7f7a9493-5c80-4293-a4ec-1e433017387a tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:09.950607 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-7f7a9493-5c80-4293-a4ec-1e433017387a tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:09.951038 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-7f7a9493-5c80-4293-a4ec-1e433017387a tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:10.075351 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.wsgi [None req-7f7a9493-5c80-4293-a4ec-1e433017387a tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] HTTP exception thrown: Cannot 'detach_volume' instance 54d2f913-8385-4f34-8cb0-8c0f08c7a30f while it is in vm_state rescued Dec 24 10:48:10.075945 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-7f7a9493-5c80-4293-a4ec-1e433017387a tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Returning 409 to user: Cannot 'detach_volume' instance 54d2f913-8385-4f34-8cb0-8c0f08c7a30f while it is in vm_state rescued {{(pid=123431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 24 10:48:10.076795 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-7f7a9493-5c80-4293-a4ec-1e433017387a tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] 10.222.0.30 "DELETE /compute/v2.1/servers/54d2f913-8385-4f34-8cb0-8c0f08c7a30f/os-volume_attachments/47d2c387-7cc5-45d8-a04a-55cd890ed581" status: 409 len: 152 microversion: 2.1 time: 0.137761 Dec 24 10:48:10.077354 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 274/564] 10.222.0.30 () {58 vars in 1415 bytes} [Fri Dec 24 10:48:09 2021] DELETE /compute/v2.1/servers/54d2f913-8385-4f34-8cb0-8c0f08c7a30f/os-volume_attachments/47d2c387-7cc5-45d8-a04a-55cd890ed581 => generated 152 bytes in 139 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Dec 24 10:48:10.082652 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-59475c65-075b-41ad-bab4-16fdff4b4e2b tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:48:10.085595 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-59475c65-075b-41ad-bab4-16fdff4b4e2b tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] [instance: d0f3b23d-c8c0-4e9a-a625-299c00fb2e27] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:48:10.094457 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-59475c65-075b-41ad-bab4-16fdff4b4e2b tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:10.094899 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-59475c65-075b-41ad-bab4-16fdff4b4e2b tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:10.095720 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-59475c65-075b-41ad-bab4-16fdff4b4e2b tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:10.096186 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-59475c65-075b-41ad-bab4-16fdff4b4e2b tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:10.232886 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-59475c65-075b-41ad-bab4-16fdff4b4e2b tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ad5096717dc425c849dfe95ea55a6af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62d11172cdf4959a15ac1ffc5601aca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:48:10.240649 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-59475c65-075b-41ad-bab4-16fdff4b4e2b tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] 10.222.0.30 "GET /compute/v2.1/servers/d0f3b23d-c8c0-4e9a-a625-299c00fb2e27" status: 200 len: 1513 microversion: 2.1 time: 0.162367 Dec 24 10:48:10.241263 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 275/565] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:48:10 2021] GET /compute/v2.1/servers/d0f3b23d-c8c0-4e9a-a625-299c00fb2e27 => generated 1513 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:48:10.245527 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-7aa35b69-d811-4a58-b5bd-abb44d142022 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:48:10.246045 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-7aa35b69-d811-4a58-b5bd-abb44d142022 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] [instance: 54d2f913-8385-4f34-8cb0-8c0f08c7a30f] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:48:10.252141 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-7aa35b69-d811-4a58-b5bd-abb44d142022 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:10.252593 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-7aa35b69-d811-4a58-b5bd-abb44d142022 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:10.253398 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-7aa35b69-d811-4a58-b5bd-abb44d142022 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:10.253840 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-7aa35b69-d811-4a58-b5bd-abb44d142022 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:10.426922 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-a65fdd44-7530-4ba7-9eed-51c08b25fc46 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] 10.222.0.30 "POST /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.969148 Dec 24 10:48:10.427565 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 291/566] 10.222.0.30 () {62 vars in 1363 bytes} [Fri Dec 24 10:48:09 2021] POST /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0/os-volume_attachments => generated 188 bytes in 971 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 24 10:48:10.431810 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-e5968515-fcdd-44cf-b02e-3af601f7c45d tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:48:10.432632 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-e5968515-fcdd-44cf-b02e-3af601f7c45d tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] [instance: 9330dbb8-edad-4d54-afeb-8badc464250d] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:48:10.439739 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-e5968515-fcdd-44cf-b02e-3af601f7c45d tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:10.440190 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-e5968515-fcdd-44cf-b02e-3af601f7c45d tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:10.441004 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-e5968515-fcdd-44cf-b02e-3af601f7c45d tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:10.441436 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-e5968515-fcdd-44cf-b02e-3af601f7c45d tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:10.459592 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-7aa35b69-d811-4a58-b5bd-abb44d142022 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] 10.222.0.30 "POST /compute/v2.1/servers/54d2f913-8385-4f34-8cb0-8c0f08c7a30f/action" status: 202 len: 0 microversion: 2.1 time: 0.217134 Dec 24 10:48:10.460859 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 276/567] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Dec 24 10:48:10 2021] POST /compute/v2.1/servers/54d2f913-8385-4f34-8cb0-8c0f08c7a30f/action => generated 0 bytes in 219 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 24 10:48:10.471407 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-5342584a-464c-4e8a-a792-d8ab25257929 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:48:10.471407 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-5342584a-464c-4e8a-a792-d8ab25257929 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] [instance: 54d2f913-8385-4f34-8cb0-8c0f08c7a30f] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:48:10.488224 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-5342584a-464c-4e8a-a792-d8ab25257929 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:10.490714 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-5342584a-464c-4e8a-a792-d8ab25257929 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:10.491642 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-5342584a-464c-4e8a-a792-d8ab25257929 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:10.492102 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-5342584a-464c-4e8a-a792-d8ab25257929 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:10.622977 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-e5968515-fcdd-44cf-b02e-3af601f7c45d tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37516225f9244c969ed168f6a024482a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0115a5cc8b4b1e8bffb84e0f3e0b08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:48:10.631468 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-e5968515-fcdd-44cf-b02e-3af601f7c45d tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] 10.222.0.30 "GET /compute/v2.1/servers/9330dbb8-edad-4d54-afeb-8badc464250d" status: 200 len: 1724 microversion: 2.1 time: 0.202890 Dec 24 10:48:10.639763 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 292/568] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:48:10 2021] GET /compute/v2.1/servers/9330dbb8-edad-4d54-afeb-8badc464250d => generated 1724 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:48:10.648619 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-34f739de-4f98-4dec-a942-4590b5906a99 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:48:10.650581 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-34f739de-4f98-4dec-a942-4590b5906a99 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] [instance: a99a6a98-4010-4f8e-a83f-fcc490f6ece0] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:48:10.661474 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-34f739de-4f98-4dec-a942-4590b5906a99 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:10.662267 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-34f739de-4f98-4dec-a942-4590b5906a99 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:10.663669 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-34f739de-4f98-4dec-a942-4590b5906a99 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:10.664314 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-34f739de-4f98-4dec-a942-4590b5906a99 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:10.673341 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-5342584a-464c-4e8a-a792-d8ab25257929 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d627b760f74f48ac560e2ce2e74e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '378bb44ad89440e49f7e290a5d31004e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:48:10.682540 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-5342584a-464c-4e8a-a792-d8ab25257929 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] 10.222.0.30 "GET /compute/v2.1/servers/54d2f913-8385-4f34-8cb0-8c0f08c7a30f" status: 200 len: 1556 microversion: 2.1 time: 0.217687 Dec 24 10:48:10.683189 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 277/569] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:48:10 2021] GET /compute/v2.1/servers/54d2f913-8385-4f34-8cb0-8c0f08c7a30f => generated 1556 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:48:11.046529 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-34f739de-4f98-4dec-a942-4590b5906a99 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] 10.222.0.30 "POST /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0/action" status: 202 len: 0 microversion: 2.20 time: 0.404256 Dec 24 10:48:11.047181 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 293/570] 10.222.0.30 () {62 vars in 1318 bytes} [Fri Dec 24 10:48:10 2021] POST /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0/action => generated 0 bytes in 405 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Dec 24 10:48:11.055904 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-173ce662-ad1c-4453-974d-ab391b98ff26 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:48:11.056591 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-173ce662-ad1c-4453-974d-ab391b98ff26 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] [instance: a99a6a98-4010-4f8e-a83f-fcc490f6ece0] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:48:11.064798 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-173ce662-ad1c-4453-974d-ab391b98ff26 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:11.065543 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-173ce662-ad1c-4453-974d-ab391b98ff26 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:11.066569 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-173ce662-ad1c-4453-974d-ab391b98ff26 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:11.067012 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-173ce662-ad1c-4453-974d-ab391b98ff26 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:11.234559 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-173ce662-ad1c-4453-974d-ab391b98ff26 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:48:11.243903 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-173ce662-ad1c-4453-974d-ab391b98ff26 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:48:11.245838 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-173ce662-ad1c-4453-974d-ab391b98ff26 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:48:11.247190 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-173ce662-ad1c-4453-974d-ab391b98ff26 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] 10.222.0.30 "GET /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0" status: 200 len: 1750 microversion: 2.20 time: 0.195464 Dec 24 10:48:11.247972 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 278/571] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Dec 24 10:48:11 2021] GET /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0 => generated 1750 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 24 10:48:11.267302 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-01fe5a1d-9f16-427e-9ba8-5e61a6e75fb0 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:48:11.267302 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-01fe5a1d-9f16-427e-9ba8-5e61a6e75fb0 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] [instance: d0f3b23d-c8c0-4e9a-a625-299c00fb2e27] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:48:11.270677 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-01fe5a1d-9f16-427e-9ba8-5e61a6e75fb0 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:11.271179 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-01fe5a1d-9f16-427e-9ba8-5e61a6e75fb0 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:11.272193 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-01fe5a1d-9f16-427e-9ba8-5e61a6e75fb0 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:11.272629 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-01fe5a1d-9f16-427e-9ba8-5e61a6e75fb0 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:11.601900 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-01fe5a1d-9f16-427e-9ba8-5e61a6e75fb0 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ad5096717dc425c849dfe95ea55a6af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62d11172cdf4959a15ac1ffc5601aca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:48:11.616955 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-01fe5a1d-9f16-427e-9ba8-5e61a6e75fb0 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] 10.222.0.30 "GET /compute/v2.1/servers/d0f3b23d-c8c0-4e9a-a625-299c00fb2e27" status: 200 len: 1513 microversion: 2.1 time: 0.356071 Dec 24 10:48:11.639133 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 294/572] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:48:11 2021] GET /compute/v2.1/servers/d0f3b23d-c8c0-4e9a-a625-299c00fb2e27 => generated 1513 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:48:11.655453 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-b4110aa7-56ed-4b44-ba7e-63200803af18 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:48:11.657074 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-b4110aa7-56ed-4b44-ba7e-63200803af18 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] [instance: 9330dbb8-edad-4d54-afeb-8badc464250d] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:48:11.664527 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-b4110aa7-56ed-4b44-ba7e-63200803af18 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:11.665135 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-b4110aa7-56ed-4b44-ba7e-63200803af18 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:11.665918 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-b4110aa7-56ed-4b44-ba7e-63200803af18 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:11.666492 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-b4110aa7-56ed-4b44-ba7e-63200803af18 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:11.699389 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-4735be6b-9456-434b-a7e4-a687fb6b80af tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:48:11.700125 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-4735be6b-9456-434b-a7e4-a687fb6b80af tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] [instance: 54d2f913-8385-4f34-8cb0-8c0f08c7a30f] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:48:11.706686 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-4735be6b-9456-434b-a7e4-a687fb6b80af tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:11.707139 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-4735be6b-9456-434b-a7e4-a687fb6b80af tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:11.708198 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-4735be6b-9456-434b-a7e4-a687fb6b80af tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:11.709317 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-4735be6b-9456-434b-a7e4-a687fb6b80af tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:11.867267 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-b4110aa7-56ed-4b44-ba7e-63200803af18 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37516225f9244c969ed168f6a024482a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0115a5cc8b4b1e8bffb84e0f3e0b08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:48:11.875487 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-b4110aa7-56ed-4b44-ba7e-63200803af18 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] 10.222.0.30 "GET /compute/v2.1/servers/9330dbb8-edad-4d54-afeb-8badc464250d" status: 200 len: 1724 microversion: 2.1 time: 0.223978 Dec 24 10:48:11.876062 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 279/573] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:48:11 2021] GET /compute/v2.1/servers/9330dbb8-edad-4d54-afeb-8badc464250d => generated 1724 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:48:11.909175 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-4735be6b-9456-434b-a7e4-a687fb6b80af tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d627b760f74f48ac560e2ce2e74e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '378bb44ad89440e49f7e290a5d31004e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:48:11.922788 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-4735be6b-9456-434b-a7e4-a687fb6b80af tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] 10.222.0.30 "GET /compute/v2.1/servers/54d2f913-8385-4f34-8cb0-8c0f08c7a30f" status: 200 len: 1556 microversion: 2.1 time: 0.226762 Dec 24 10:48:11.923407 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 295/574] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:48:11 2021] GET /compute/v2.1/servers/54d2f913-8385-4f34-8cb0-8c0f08c7a30f => generated 1556 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 24 10:48:12.036176 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [req-5c51a4d4-4ca1-440d-8632-0f0e3f1e7261 req-8affed89-1b65-4b8b-9bde-148175bf4534 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0f3b23d-c8c0-4e9a-a625-299c00fb2e27", "name": "network-vif-deleted", "tag": "4fde9d66-dead-4e85-8d7f-9dffb8700f99"}]} {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:48:12.038018 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 10:48:12.038018 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: warnings.warn(msg) Dec 24 10:48:12.053565 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [req-5c51a4d4-4ca1-440d-8632-0f0e3f1e7261 req-8affed89-1b65-4b8b-9bde-148175bf4534 service nova] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:12.054246 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [req-5c51a4d4-4ca1-440d-8632-0f0e3f1e7261 req-8affed89-1b65-4b8b-9bde-148175bf4534 service nova] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:12.070530 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.compute.server_external_events [req-5c51a4d4-4ca1-440d-8632-0f0e3f1e7261 req-8affed89-1b65-4b8b-9bde-148175bf4534 service nova] Creating event network-vif-deleted:4fde9d66-dead-4e85-8d7f-9dffb8700f99 for instance d0f3b23d-c8c0-4e9a-a625-299c00fb2e27 on hv-cinder-81644 Dec 24 10:48:12.075665 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [req-5c51a4d4-4ca1-440d-8632-0f0e3f1e7261 req-8affed89-1b65-4b8b-9bde-148175bf4534 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045076 Dec 24 10:48:12.076971 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 280/575] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Dec 24 10:48:12 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 10:48:12.267854 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-a3911e45-ed38-4f99-8a9c-eebbe39819fa tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:48:12.268464 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-a3911e45-ed38-4f99-8a9c-eebbe39819fa tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] [instance: a99a6a98-4010-4f8e-a83f-fcc490f6ece0] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:48:12.274818 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-a3911e45-ed38-4f99-8a9c-eebbe39819fa tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:12.275267 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-a3911e45-ed38-4f99-8a9c-eebbe39819fa tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:12.276054 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-a3911e45-ed38-4f99-8a9c-eebbe39819fa tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:12.276490 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-a3911e45-ed38-4f99-8a9c-eebbe39819fa tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:12.425485 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-a3911e45-ed38-4f99-8a9c-eebbe39819fa tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:48:12.435503 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-a3911e45-ed38-4f99-8a9c-eebbe39819fa tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:48:12.437038 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-a3911e45-ed38-4f99-8a9c-eebbe39819fa tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:48:12.438226 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-a3911e45-ed38-4f99-8a9c-eebbe39819fa tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] 10.222.0.30 "GET /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0" status: 200 len: 1750 microversion: 2.20 time: 0.174862 Dec 24 10:48:12.438784 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 296/576] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Dec 24 10:48:12 2021] GET /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0 => generated 1750 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 10:48:12.647826 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-69326edc-3540-49c1-a097-fcc3974096e7 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:48:12.652799 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-69326edc-3540-49c1-a097-fcc3974096e7 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] [instance: d0f3b23d-c8c0-4e9a-a625-299c00fb2e27] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:48:12.654503 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-69326edc-3540-49c1-a097-fcc3974096e7 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:12.654950 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-69326edc-3540-49c1-a097-fcc3974096e7 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:12.655714 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-69326edc-3540-49c1-a097-fcc3974096e7 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:12.656150 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-69326edc-3540-49c1-a097-fcc3974096e7 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:12.692271 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-69326edc-3540-49c1-a097-fcc3974096e7 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:12.692847 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-69326edc-3540-49c1-a097-fcc3974096e7 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:12.693614 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.objects.instance [None req-69326edc-3540-49c1-a097-fcc3974096e7 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lazy-loading 'fault' on Instance uuid d0f3b23d-c8c0-4e9a-a625-299c00fb2e27 {{(pid=123431) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 24 10:48:12.741608 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-69326edc-3540-49c1-a097-fcc3974096e7 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ad5096717dc425c849dfe95ea55a6af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62d11172cdf4959a15ac1ffc5601aca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:48:12.748787 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-69326edc-3540-49c1-a097-fcc3974096e7 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] 10.222.0.30 "GET /compute/v2.1/servers/d0f3b23d-c8c0-4e9a-a625-299c00fb2e27" status: 200 len: 1307 microversion: 2.1 time: 0.105288 Dec 24 10:48:12.749367 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 281/577] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:48:12 2021] GET /compute/v2.1/servers/d0f3b23d-c8c0-4e9a-a625-299c00fb2e27 => generated 1307 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:48:12.891688 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-6423a7f3-9a8a-45e9-9355-c3949a7d5707 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:48:12.893138 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-6423a7f3-9a8a-45e9-9355-c3949a7d5707 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] [instance: 9330dbb8-edad-4d54-afeb-8badc464250d] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:48:12.907776 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-6423a7f3-9a8a-45e9-9355-c3949a7d5707 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:12.908222 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-6423a7f3-9a8a-45e9-9355-c3949a7d5707 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:12.909074 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-6423a7f3-9a8a-45e9-9355-c3949a7d5707 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:12.909500 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-6423a7f3-9a8a-45e9-9355-c3949a7d5707 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:12.940355 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-ac955fdf-593a-4d4d-9a6e-b87c634c6566 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:48:12.941033 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-ac955fdf-593a-4d4d-9a6e-b87c634c6566 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] [instance: 54d2f913-8385-4f34-8cb0-8c0f08c7a30f] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:48:12.947374 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-ac955fdf-593a-4d4d-9a6e-b87c634c6566 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:12.947820 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-ac955fdf-593a-4d4d-9a6e-b87c634c6566 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:12.948847 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-ac955fdf-593a-4d4d-9a6e-b87c634c6566 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:12.949284 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-ac955fdf-593a-4d4d-9a6e-b87c634c6566 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:13.052787 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-6423a7f3-9a8a-45e9-9355-c3949a7d5707 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37516225f9244c969ed168f6a024482a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0115a5cc8b4b1e8bffb84e0f3e0b08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:48:13.061005 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-6423a7f3-9a8a-45e9-9355-c3949a7d5707 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] 10.222.0.30 "GET /compute/v2.1/servers/9330dbb8-edad-4d54-afeb-8badc464250d" status: 200 len: 1724 microversion: 2.1 time: 0.172797 Dec 24 10:48:13.062919 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 297/578] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:48:12 2021] GET /compute/v2.1/servers/9330dbb8-edad-4d54-afeb-8badc464250d => generated 1724 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:48:13.104427 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-ac955fdf-593a-4d4d-9a6e-b87c634c6566 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d627b760f74f48ac560e2ce2e74e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '378bb44ad89440e49f7e290a5d31004e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:48:13.113454 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-ac955fdf-593a-4d4d-9a6e-b87c634c6566 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] 10.222.0.30 "GET /compute/v2.1/servers/54d2f913-8385-4f34-8cb0-8c0f08c7a30f" status: 200 len: 1556 microversion: 2.1 time: 0.177585 Dec 24 10:48:13.114127 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 282/579] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:48:12 2021] GET /compute/v2.1/servers/54d2f913-8385-4f34-8cb0-8c0f08c7a30f => generated 1556 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:48:13.457542 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-cb2eafd8-7dbe-4525-8347-a4ef2eb053f1 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:48:13.458034 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-cb2eafd8-7dbe-4525-8347-a4ef2eb053f1 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] [instance: a99a6a98-4010-4f8e-a83f-fcc490f6ece0] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:48:13.464932 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-cb2eafd8-7dbe-4525-8347-a4ef2eb053f1 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:13.465401 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-cb2eafd8-7dbe-4525-8347-a4ef2eb053f1 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:13.466233 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-cb2eafd8-7dbe-4525-8347-a4ef2eb053f1 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:13.466711 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-cb2eafd8-7dbe-4525-8347-a4ef2eb053f1 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:13.592109 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-cb2eafd8-7dbe-4525-8347-a4ef2eb053f1 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:48:13.600797 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-cb2eafd8-7dbe-4525-8347-a4ef2eb053f1 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:48:13.602373 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-cb2eafd8-7dbe-4525-8347-a4ef2eb053f1 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:48:13.603640 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-cb2eafd8-7dbe-4525-8347-a4ef2eb053f1 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] 10.222.0.30 "GET /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0" status: 200 len: 1752 microversion: 2.20 time: 0.150637 Dec 24 10:48:13.604305 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 298/580] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Dec 24 10:48:13 2021] GET /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0 => generated 1752 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 10:48:13.764626 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-caba3040-3396-49a0-bd96-85d455bac152 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:48:13.765271 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-caba3040-3396-49a0-bd96-85d455bac152 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] [instance: d0f3b23d-c8c0-4e9a-a625-299c00fb2e27] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:48:13.771870 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-caba3040-3396-49a0-bd96-85d455bac152 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:13.773718 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-caba3040-3396-49a0-bd96-85d455bac152 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:13.773718 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-caba3040-3396-49a0-bd96-85d455bac152 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:13.773718 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-caba3040-3396-49a0-bd96-85d455bac152 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:13.787738 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.wsgi [None req-caba3040-3396-49a0-bd96-85d455bac152 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] HTTP exception thrown: Instance d0f3b23d-c8c0-4e9a-a625-299c00fb2e27 could not be found. Dec 24 10:48:13.788357 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-caba3040-3396-49a0-bd96-85d455bac152 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Returning 404 to user: Instance d0f3b23d-c8c0-4e9a-a625-299c00fb2e27 could not be found. {{(pid=123431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 24 10:48:13.789233 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-caba3040-3396-49a0-bd96-85d455bac152 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] 10.222.0.30 "GET /compute/v2.1/servers/d0f3b23d-c8c0-4e9a-a625-299c00fb2e27" status: 404 len: 111 microversion: 2.1 time: 0.028330 Dec 24 10:48:13.789797 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 283/581] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:48:13 2021] GET /compute/v2.1/servers/d0f3b23d-c8c0-4e9a-a625-299c00fb2e27 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 24 10:48:14.077672 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-cd39cd18-1905-4f4d-a47e-c7f190b71e01 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:48:14.083677 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-cd39cd18-1905-4f4d-a47e-c7f190b71e01 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] [instance: 9330dbb8-edad-4d54-afeb-8badc464250d] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:48:14.084738 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-cd39cd18-1905-4f4d-a47e-c7f190b71e01 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:14.085215 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-cd39cd18-1905-4f4d-a47e-c7f190b71e01 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:14.086049 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-cd39cd18-1905-4f4d-a47e-c7f190b71e01 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:14.086494 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-cd39cd18-1905-4f4d-a47e-c7f190b71e01 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:14.134419 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-3e9f05de-c149-460e-9349-c44fef5929f4 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:48:14.135024 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-3e9f05de-c149-460e-9349-c44fef5929f4 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] [instance: 54d2f913-8385-4f34-8cb0-8c0f08c7a30f] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:48:14.141304 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-3e9f05de-c149-460e-9349-c44fef5929f4 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:14.141747 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-3e9f05de-c149-460e-9349-c44fef5929f4 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:14.142551 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-3e9f05de-c149-460e-9349-c44fef5929f4 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:14.142980 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-3e9f05de-c149-460e-9349-c44fef5929f4 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:14.222157 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-cd39cd18-1905-4f4d-a47e-c7f190b71e01 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37516225f9244c969ed168f6a024482a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0115a5cc8b4b1e8bffb84e0f3e0b08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:48:14.230270 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-cd39cd18-1905-4f4d-a47e-c7f190b71e01 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] 10.222.0.30 "GET /compute/v2.1/servers/9330dbb8-edad-4d54-afeb-8badc464250d" status: 200 len: 1724 microversion: 2.1 time: 0.156227 Dec 24 10:48:14.230845 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 299/582] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:48:14 2021] GET /compute/v2.1/servers/9330dbb8-edad-4d54-afeb-8badc464250d => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:48:14.281244 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-3e9f05de-c149-460e-9349-c44fef5929f4 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d627b760f74f48ac560e2ce2e74e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '378bb44ad89440e49f7e290a5d31004e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:48:14.292912 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-3e9f05de-c149-460e-9349-c44fef5929f4 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] 10.222.0.30 "GET /compute/v2.1/servers/54d2f913-8385-4f34-8cb0-8c0f08c7a30f" status: 200 len: 1562 microversion: 2.1 time: 0.161936 Dec 24 10:48:14.294073 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 284/583] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:48:14 2021] GET /compute/v2.1/servers/54d2f913-8385-4f34-8cb0-8c0f08c7a30f => generated 1562 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 24 10:48:14.358775 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-a4f99ab1-2a93-4e37-b8a7-6ce58b292f3f tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:48:14.359263 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-a4f99ab1-2a93-4e37-b8a7-6ce58b292f3f tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] [instance: 54d2f913-8385-4f34-8cb0-8c0f08c7a30f] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:48:14.365519 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-a4f99ab1-2a93-4e37-b8a7-6ce58b292f3f tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:14.370801 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-a4f99ab1-2a93-4e37-b8a7-6ce58b292f3f tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:14.370801 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-a4f99ab1-2a93-4e37-b8a7-6ce58b292f3f tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:14.370801 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-a4f99ab1-2a93-4e37-b8a7-6ce58b292f3f tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:14.443893 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.objects.instance [None req-a4f99ab1-2a93-4e37-b8a7-6ce58b292f3f tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lazy-loading 'services' on Instance uuid 54d2f913-8385-4f34-8cb0-8c0f08c7a30f {{(pid=123432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 24 10:48:14.622514 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-a51acda4-61d8-41a2-b1de-fa01309ed6b7 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:48:14.623121 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-a51acda4-61d8-41a2-b1de-fa01309ed6b7 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] [instance: a99a6a98-4010-4f8e-a83f-fcc490f6ece0] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:48:14.629021 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-a51acda4-61d8-41a2-b1de-fa01309ed6b7 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:14.629466 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-a51acda4-61d8-41a2-b1de-fa01309ed6b7 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:14.630234 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-a51acda4-61d8-41a2-b1de-fa01309ed6b7 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:14.630663 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-a51acda4-61d8-41a2-b1de-fa01309ed6b7 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:14.689253 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-a4f99ab1-2a93-4e37-b8a7-6ce58b292f3f tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] 10.222.0.30 "DELETE /compute/v2.1/servers/54d2f913-8385-4f34-8cb0-8c0f08c7a30f/os-volume_attachments/47d2c387-7cc5-45d8-a04a-55cd890ed581" status: 202 len: 0 microversion: 2.1 time: 0.333843 Dec 24 10:48:14.690210 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 300/584] 10.222.0.30 () {58 vars in 1415 bytes} [Fri Dec 24 10:48:14 2021] DELETE /compute/v2.1/servers/54d2f913-8385-4f34-8cb0-8c0f08c7a30f/os-volume_attachments/47d2c387-7cc5-45d8-a04a-55cd890ed581 => generated 0 bytes in 336 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 24 10:48:14.700064 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-6b418286-e4dd-4fcb-b4d0-f6cc3a48e84d tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:48:14.701858 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-6b418286-e4dd-4fcb-b4d0-f6cc3a48e84d tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] [instance: 54d2f913-8385-4f34-8cb0-8c0f08c7a30f] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:48:14.709968 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-6b418286-e4dd-4fcb-b4d0-f6cc3a48e84d tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:14.710413 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-6b418286-e4dd-4fcb-b4d0-f6cc3a48e84d tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:14.711203 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-6b418286-e4dd-4fcb-b4d0-f6cc3a48e84d tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:14.711935 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-6b418286-e4dd-4fcb-b4d0-f6cc3a48e84d tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:14.742697 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-6b418286-e4dd-4fcb-b4d0-f6cc3a48e84d tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] 10.222.0.30 "GET /compute/v2.1/servers/54d2f913-8385-4f34-8cb0-8c0f08c7a30f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047194 Dec 24 10:48:14.743261 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 301/585] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Dec 24 10:48:14 2021] GET /compute/v2.1/servers/54d2f913-8385-4f34-8cb0-8c0f08c7a30f/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 24 10:48:14.763472 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-a51acda4-61d8-41a2-b1de-fa01309ed6b7 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:48:14.772377 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-a51acda4-61d8-41a2-b1de-fa01309ed6b7 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:48:14.773885 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-a51acda4-61d8-41a2-b1de-fa01309ed6b7 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:48:14.775064 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-a51acda4-61d8-41a2-b1de-fa01309ed6b7 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] 10.222.0.30 "GET /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0" status: 200 len: 1752 microversion: 2.20 time: 0.156280 Dec 24 10:48:14.776588 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 285/586] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Dec 24 10:48:14 2021] GET /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0 => generated 1752 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 24 10:48:15.094724 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-c0639c25-9d4b-4415-af45-8f1481453cb3 tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:48:15.095428 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-c0639c25-9d4b-4415-af45-8f1481453cb3 tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] [instance: 12183d8e-4c50-449a-a93d-cee72f597b3d] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:48:15.104650 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-c0639c25-9d4b-4415-af45-8f1481453cb3 tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:15.105712 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-c0639c25-9d4b-4415-af45-8f1481453cb3 tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:15.106540 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-c0639c25-9d4b-4415-af45-8f1481453cb3 tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:15.106973 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-c0639c25-9d4b-4415-af45-8f1481453cb3 tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:15.140192 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-622c15c4-01e3-426b-93ab-ed717a5b4222 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:48:15.140873 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-622c15c4-01e3-426b-93ab-ed717a5b4222 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] [instance: fb8d3af9-4513-4f65-8863-0f910fd46f04] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:48:15.148243 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-622c15c4-01e3-426b-93ab-ed717a5b4222 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:15.148711 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-622c15c4-01e3-426b-93ab-ed717a5b4222 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:15.149805 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-622c15c4-01e3-426b-93ab-ed717a5b4222 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:15.150239 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-622c15c4-01e3-426b-93ab-ed717a5b4222 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:15.177509 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-622c15c4-01e3-426b-93ab-ed717a5b4222 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] [instance: fb8d3af9-4513-4f65-8863-0f910fd46f04] Going to try to terminate instance {{(pid=123431) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 24 10:48:15.250107 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-c0639c25-9d4b-4415-af45-8f1481453cb3 tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e2194bc8c0d44b186956c1b38a0c04a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed29a38d2fe424398ac10e585a980df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:48:15.258581 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-c0639c25-9d4b-4415-af45-8f1481453cb3 tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] 10.222.0.30 "GET /compute/v2.1/servers/12183d8e-4c50-449a-a93d-cee72f597b3d" status: 200 len: 1594 microversion: 2.1 time: 0.167520 Dec 24 10:48:15.259143 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 302/587] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:48:15 2021] GET /compute/v2.1/servers/12183d8e-4c50-449a-a93d-cee72f597b3d => generated 1594 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:48:15.263399 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-c08a5b26-06ba-48cf-94c8-2969d73fb701 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:48:15.264020 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-c08a5b26-06ba-48cf-94c8-2969d73fb701 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] [instance: 9330dbb8-edad-4d54-afeb-8badc464250d] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:48:15.270546 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-c08a5b26-06ba-48cf-94c8-2969d73fb701 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:15.271044 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-c08a5b26-06ba-48cf-94c8-2969d73fb701 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:15.272141 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-c08a5b26-06ba-48cf-94c8-2969d73fb701 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:15.272511 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-c08a5b26-06ba-48cf-94c8-2969d73fb701 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:15.418204 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-c08a5b26-06ba-48cf-94c8-2969d73fb701 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37516225f9244c969ed168f6a024482a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0115a5cc8b4b1e8bffb84e0f3e0b08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:48:15.426977 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-c08a5b26-06ba-48cf-94c8-2969d73fb701 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] 10.222.0.30 "GET /compute/v2.1/servers/9330dbb8-edad-4d54-afeb-8badc464250d" status: 200 len: 1724 microversion: 2.1 time: 0.166800 Dec 24 10:48:15.427793 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 303/588] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:48:15 2021] GET /compute/v2.1/servers/9330dbb8-edad-4d54-afeb-8badc464250d => generated 1724 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:48:15.542632 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-622c15c4-01e3-426b-93ab-ed717a5b4222 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] 10.222.0.30 "DELETE /compute/v2.1/servers/fb8d3af9-4513-4f65-8863-0f910fd46f04" status: 204 len: 0 microversion: 2.1 time: 0.405087 Dec 24 10:48:15.543582 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 286/589] 10.222.0.30 () {58 vars in 1238 bytes} [Fri Dec 24 10:48:15 2021] DELETE /compute/v2.1/servers/fb8d3af9-4513-4f65-8863-0f910fd46f04 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Dec 24 10:48:15.551340 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-99d797ab-6937-4b01-81ba-7548a348914e tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:48:15.551976 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-99d797ab-6937-4b01-81ba-7548a348914e tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] [instance: fb8d3af9-4513-4f65-8863-0f910fd46f04] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:48:15.558371 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-99d797ab-6937-4b01-81ba-7548a348914e tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:15.558818 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-99d797ab-6937-4b01-81ba-7548a348914e tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:15.559598 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-99d797ab-6937-4b01-81ba-7548a348914e tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:15.560170 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-99d797ab-6937-4b01-81ba-7548a348914e tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:15.709152 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-99d797ab-6937-4b01-81ba-7548a348914e tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ad5096717dc425c849dfe95ea55a6af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62d11172cdf4959a15ac1ffc5601aca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:48:15.719525 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-99d797ab-6937-4b01-81ba-7548a348914e tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] 10.222.0.30 "GET /compute/v2.1/servers/fb8d3af9-4513-4f65-8863-0f910fd46f04" status: 200 len: 1513 microversion: 2.1 time: 0.171794 Dec 24 10:48:15.729717 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 304/590] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:48:15 2021] GET /compute/v2.1/servers/fb8d3af9-4513-4f65-8863-0f910fd46f04 => generated 1513 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:48:15.754981 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-be2299fc-9c7b-4280-aae5-3d5b2b029d65 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:48:15.757516 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-be2299fc-9c7b-4280-aae5-3d5b2b029d65 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] [instance: 54d2f913-8385-4f34-8cb0-8c0f08c7a30f] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:48:15.762443 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-be2299fc-9c7b-4280-aae5-3d5b2b029d65 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:15.762830 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-be2299fc-9c7b-4280-aae5-3d5b2b029d65 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:15.763617 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-be2299fc-9c7b-4280-aae5-3d5b2b029d65 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:15.764039 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-be2299fc-9c7b-4280-aae5-3d5b2b029d65 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:15.795338 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-bae9db1a-5769-4f6f-a8af-08a4c2ebff28 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:48:15.796476 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-bae9db1a-5769-4f6f-a8af-08a4c2ebff28 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] [instance: a99a6a98-4010-4f8e-a83f-fcc490f6ece0] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:48:15.798429 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-be2299fc-9c7b-4280-aae5-3d5b2b029d65 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] 10.222.0.30 "GET /compute/v2.1/servers/54d2f913-8385-4f34-8cb0-8c0f08c7a30f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047660 Dec 24 10:48:15.799010 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 287/591] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Dec 24 10:48:15 2021] GET /compute/v2.1/servers/54d2f913-8385-4f34-8cb0-8c0f08c7a30f/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 10:48:15.805703 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-bae9db1a-5769-4f6f-a8af-08a4c2ebff28 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:15.806147 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-bae9db1a-5769-4f6f-a8af-08a4c2ebff28 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:15.809697 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-bae9db1a-5769-4f6f-a8af-08a4c2ebff28 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:15.809697 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-bae9db1a-5769-4f6f-a8af-08a4c2ebff28 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:15.946643 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-bae9db1a-5769-4f6f-a8af-08a4c2ebff28 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:48:15.957196 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-bae9db1a-5769-4f6f-a8af-08a4c2ebff28 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:48:15.964889 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-bae9db1a-5769-4f6f-a8af-08a4c2ebff28 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:48:15.964889 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-bae9db1a-5769-4f6f-a8af-08a4c2ebff28 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] 10.222.0.30 "GET /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0" status: 200 len: 1808 microversion: 2.20 time: 0.169620 Dec 24 10:48:15.964889 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 305/592] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Dec 24 10:48:15 2021] GET /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0 => generated 1808 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 24 10:48:16.444777 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-514762f3-9ba9-43bb-b112-f3233eb341d2 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:48:16.445461 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-514762f3-9ba9-43bb-b112-f3233eb341d2 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] [instance: 9330dbb8-edad-4d54-afeb-8badc464250d] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:48:16.451516 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-514762f3-9ba9-43bb-b112-f3233eb341d2 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:16.451921 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-514762f3-9ba9-43bb-b112-f3233eb341d2 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:16.452751 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-514762f3-9ba9-43bb-b112-f3233eb341d2 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:16.453239 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-514762f3-9ba9-43bb-b112-f3233eb341d2 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:16.636557 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-514762f3-9ba9-43bb-b112-f3233eb341d2 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37516225f9244c969ed168f6a024482a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0115a5cc8b4b1e8bffb84e0f3e0b08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:48:16.644304 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-514762f3-9ba9-43bb-b112-f3233eb341d2 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] 10.222.0.30 "GET /compute/v2.1/servers/9330dbb8-edad-4d54-afeb-8badc464250d" status: 200 len: 1724 microversion: 2.1 time: 0.203946 Dec 24 10:48:16.644909 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 288/593] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:48:16 2021] GET /compute/v2.1/servers/9330dbb8-edad-4d54-afeb-8badc464250d => generated 1724 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:48:16.738032 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-8e71b589-235b-4a88-9ba3-7258e7cb45c7 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:48:16.738593 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-8e71b589-235b-4a88-9ba3-7258e7cb45c7 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] [instance: fb8d3af9-4513-4f65-8863-0f910fd46f04] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:48:16.744580 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-8e71b589-235b-4a88-9ba3-7258e7cb45c7 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:16.745066 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-8e71b589-235b-4a88-9ba3-7258e7cb45c7 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:16.745838 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-8e71b589-235b-4a88-9ba3-7258e7cb45c7 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:16.746266 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-8e71b589-235b-4a88-9ba3-7258e7cb45c7 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:16.809002 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-5978b76f-0f8b-42d7-8013-699635d5cfc8 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:48:16.809915 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-5978b76f-0f8b-42d7-8013-699635d5cfc8 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] [instance: 54d2f913-8385-4f34-8cb0-8c0f08c7a30f] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:48:16.815905 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-5978b76f-0f8b-42d7-8013-699635d5cfc8 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:16.816852 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-5978b76f-0f8b-42d7-8013-699635d5cfc8 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:16.817441 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-5978b76f-0f8b-42d7-8013-699635d5cfc8 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:16.818019 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-5978b76f-0f8b-42d7-8013-699635d5cfc8 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:16.849139 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-5978b76f-0f8b-42d7-8013-699635d5cfc8 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] 10.222.0.30 "GET /compute/v2.1/servers/54d2f913-8385-4f34-8cb0-8c0f08c7a30f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043896 Dec 24 10:48:16.850014 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 289/594] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Dec 24 10:48:16 2021] GET /compute/v2.1/servers/54d2f913-8385-4f34-8cb0-8c0f08c7a30f/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Dec 24 10:48:16.915240 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-8e71b589-235b-4a88-9ba3-7258e7cb45c7 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ad5096717dc425c849dfe95ea55a6af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62d11172cdf4959a15ac1ffc5601aca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:48:16.922691 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-8e71b589-235b-4a88-9ba3-7258e7cb45c7 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] 10.222.0.30 "GET /compute/v2.1/servers/fb8d3af9-4513-4f65-8863-0f910fd46f04" status: 200 len: 1513 microversion: 2.1 time: 0.189288 Dec 24 10:48:16.923825 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 306/595] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:48:16 2021] GET /compute/v2.1/servers/fb8d3af9-4513-4f65-8863-0f910fd46f04 => generated 1513 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:48:16.977114 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-9de6aea6-d3a6-48ef-9f37-01baefdc1b66 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:48:16.977742 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-9de6aea6-d3a6-48ef-9f37-01baefdc1b66 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] [instance: a99a6a98-4010-4f8e-a83f-fcc490f6ece0] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:48:16.983613 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-9de6aea6-d3a6-48ef-9f37-01baefdc1b66 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:16.984083 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-9de6aea6-d3a6-48ef-9f37-01baefdc1b66 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:16.984894 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-9de6aea6-d3a6-48ef-9f37-01baefdc1b66 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:16.985323 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-9de6aea6-d3a6-48ef-9f37-01baefdc1b66 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:17.464659 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-9de6aea6-d3a6-48ef-9f37-01baefdc1b66 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:48:17.487972 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-9de6aea6-d3a6-48ef-9f37-01baefdc1b66 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:48:17.489726 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-9de6aea6-d3a6-48ef-9f37-01baefdc1b66 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:48:17.492068 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-9de6aea6-d3a6-48ef-9f37-01baefdc1b66 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] 10.222.0.30 "GET /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0" status: 200 len: 1808 microversion: 2.20 time: 0.518590 Dec 24 10:48:17.515843 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 290/596] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Dec 24 10:48:16 2021] GET /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0 => generated 1808 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 10:48:17.662672 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-57f66dad-4a46-412d-892f-d22c18c7dae8 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:48:17.663734 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-57f66dad-4a46-412d-892f-d22c18c7dae8 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] [instance: 9330dbb8-edad-4d54-afeb-8badc464250d] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:48:17.670077 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-57f66dad-4a46-412d-892f-d22c18c7dae8 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:17.670863 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-57f66dad-4a46-412d-892f-d22c18c7dae8 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:17.671806 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-57f66dad-4a46-412d-892f-d22c18c7dae8 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:17.672350 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-57f66dad-4a46-412d-892f-d22c18c7dae8 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:17.858639 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-57f66dad-4a46-412d-892f-d22c18c7dae8 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37516225f9244c969ed168f6a024482a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0115a5cc8b4b1e8bffb84e0f3e0b08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:48:17.867568 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-57f66dad-4a46-412d-892f-d22c18c7dae8 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] 10.222.0.30 "GET /compute/v2.1/servers/9330dbb8-edad-4d54-afeb-8badc464250d" status: 200 len: 1724 microversion: 2.1 time: 0.209614 Dec 24 10:48:17.868135 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 307/597] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:48:17 2021] GET /compute/v2.1/servers/9330dbb8-edad-4d54-afeb-8badc464250d => generated 1724 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:48:17.939513 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-2ca1fd97-14ee-4a38-8ec7-28f7bff5f713 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:48:17.943515 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-2ca1fd97-14ee-4a38-8ec7-28f7bff5f713 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] [instance: fb8d3af9-4513-4f65-8863-0f910fd46f04] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:48:17.946991 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-2ca1fd97-14ee-4a38-8ec7-28f7bff5f713 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:17.947746 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-2ca1fd97-14ee-4a38-8ec7-28f7bff5f713 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:17.948754 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-2ca1fd97-14ee-4a38-8ec7-28f7bff5f713 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:17.949442 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-2ca1fd97-14ee-4a38-8ec7-28f7bff5f713 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:17.988733 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [req-6702fea9-6493-43d0-b6cc-7e2da22b8b4a req-cddadd8e-041d-4ab6-8d5f-3a1761fc077d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "12183d8e-4c50-449a-a93d-cee72f597b3d", "tag": "abebf56e-a643-48ae-a779-897dbd105170"}]} {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:48:17.990680 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 10:48:17.990680 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: warnings.warn(msg) Dec 24 10:48:18.013000 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [req-6702fea9-6493-43d0-b6cc-7e2da22b8b4a req-cddadd8e-041d-4ab6-8d5f-3a1761fc077d service nova] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:18.013908 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [req-6702fea9-6493-43d0-b6cc-7e2da22b8b4a req-cddadd8e-041d-4ab6-8d5f-3a1761fc077d service nova] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:18.039221 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.compute.server_external_events [req-6702fea9-6493-43d0-b6cc-7e2da22b8b4a req-cddadd8e-041d-4ab6-8d5f-3a1761fc077d service nova] Creating event network-changed:abebf56e-a643-48ae-a779-897dbd105170 for instance 12183d8e-4c50-449a-a93d-cee72f597b3d on hv-cinder-81644 Dec 24 10:48:18.044465 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [req-6702fea9-6493-43d0-b6cc-7e2da22b8b4a req-cddadd8e-041d-4ab6-8d5f-3a1761fc077d service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059582 Dec 24 10:48:18.045397 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 308/598] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Dec 24 10:48:17 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 24 10:48:18.206342 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-2ca1fd97-14ee-4a38-8ec7-28f7bff5f713 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ad5096717dc425c849dfe95ea55a6af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62d11172cdf4959a15ac1ffc5601aca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:48:18.209136 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-2ca1fd97-14ee-4a38-8ec7-28f7bff5f713 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] 10.222.0.30 "GET /compute/v2.1/servers/fb8d3af9-4513-4f65-8863-0f910fd46f04" status: 200 len: 1513 microversion: 2.1 time: 0.273211 Dec 24 10:48:18.210120 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 291/599] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:48:17 2021] GET /compute/v2.1/servers/fb8d3af9-4513-4f65-8863-0f910fd46f04 => generated 1513 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 24 10:48:18.524935 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-52394108-911e-43c4-9c84-3bb68d6c6a41 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:48:18.525632 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-52394108-911e-43c4-9c84-3bb68d6c6a41 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] [instance: a99a6a98-4010-4f8e-a83f-fcc490f6ece0] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:48:18.531844 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-52394108-911e-43c4-9c84-3bb68d6c6a41 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:18.533293 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-52394108-911e-43c4-9c84-3bb68d6c6a41 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:18.534083 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-52394108-911e-43c4-9c84-3bb68d6c6a41 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:18.534518 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-52394108-911e-43c4-9c84-3bb68d6c6a41 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:18.752807 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-52394108-911e-43c4-9c84-3bb68d6c6a41 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:48:18.761019 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-52394108-911e-43c4-9c84-3bb68d6c6a41 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:48:18.762505 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-52394108-911e-43c4-9c84-3bb68d6c6a41 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:48:18.763633 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-52394108-911e-43c4-9c84-3bb68d6c6a41 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] 10.222.0.30 "GET /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0" status: 200 len: 1808 microversion: 2.20 time: 0.244021 Dec 24 10:48:18.764179 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 309/600] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Dec 24 10:48:18 2021] GET /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0 => generated 1808 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 10:48:18.885603 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-cfd234b8-90b1-4669-bf30-f6b107d626ec tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:48:18.886297 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-cfd234b8-90b1-4669-bf30-f6b107d626ec tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] [instance: 9330dbb8-edad-4d54-afeb-8badc464250d] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:48:18.896907 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-cfd234b8-90b1-4669-bf30-f6b107d626ec tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:18.896907 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-cfd234b8-90b1-4669-bf30-f6b107d626ec tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:18.896907 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-cfd234b8-90b1-4669-bf30-f6b107d626ec tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:18.896907 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-cfd234b8-90b1-4669-bf30-f6b107d626ec tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:19.081388 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-cfd234b8-90b1-4669-bf30-f6b107d626ec tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37516225f9244c969ed168f6a024482a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0115a5cc8b4b1e8bffb84e0f3e0b08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:48:19.092160 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-cfd234b8-90b1-4669-bf30-f6b107d626ec tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] 10.222.0.30 "GET /compute/v2.1/servers/9330dbb8-edad-4d54-afeb-8badc464250d" status: 200 len: 1724 microversion: 2.1 time: 0.210197 Dec 24 10:48:19.094054 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 292/601] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:48:18 2021] GET /compute/v2.1/servers/9330dbb8-edad-4d54-afeb-8badc464250d => generated 1724 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:48:19.228128 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-0353b9b6-17a3-44b3-be28-2f7277abf902 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:48:19.228757 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-0353b9b6-17a3-44b3-be28-2f7277abf902 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] [instance: fb8d3af9-4513-4f65-8863-0f910fd46f04] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:48:19.237278 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-0353b9b6-17a3-44b3-be28-2f7277abf902 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:19.238163 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-0353b9b6-17a3-44b3-be28-2f7277abf902 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:19.239769 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-0353b9b6-17a3-44b3-be28-2f7277abf902 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:19.241150 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-0353b9b6-17a3-44b3-be28-2f7277abf902 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:19.422874 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-0353b9b6-17a3-44b3-be28-2f7277abf902 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ad5096717dc425c849dfe95ea55a6af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62d11172cdf4959a15ac1ffc5601aca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:48:19.436702 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-0353b9b6-17a3-44b3-be28-2f7277abf902 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] 10.222.0.30 "GET /compute/v2.1/servers/fb8d3af9-4513-4f65-8863-0f910fd46f04" status: 200 len: 1513 microversion: 2.1 time: 0.212350 Dec 24 10:48:19.439470 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 310/602] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:48:19 2021] GET /compute/v2.1/servers/fb8d3af9-4513-4f65-8863-0f910fd46f04 => generated 1513 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:48:19.755480 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-98375bd4-f54a-4837-972f-0d358ebca5bd tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:48:19.755967 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-98375bd4-f54a-4837-972f-0d358ebca5bd tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] [instance: c2c661f2-d3da-4357-a7a8-3f85fc94cc60] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:48:19.761834 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-98375bd4-f54a-4837-972f-0d358ebca5bd tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:19.762250 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-98375bd4-f54a-4837-972f-0d358ebca5bd tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:19.763016 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-98375bd4-f54a-4837-972f-0d358ebca5bd tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:19.763445 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-98375bd4-f54a-4837-972f-0d358ebca5bd tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:19.782938 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-bd8b79cd-7699-41e5-b838-35975dabb357 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:48:19.784053 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-bd8b79cd-7699-41e5-b838-35975dabb357 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] [instance: a99a6a98-4010-4f8e-a83f-fcc490f6ece0] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:48:19.792327 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-bd8b79cd-7699-41e5-b838-35975dabb357 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:19.797881 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-bd8b79cd-7699-41e5-b838-35975dabb357 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:19.797881 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-bd8b79cd-7699-41e5-b838-35975dabb357 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:19.797881 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-bd8b79cd-7699-41e5-b838-35975dabb357 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:19.799919 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-98375bd4-f54a-4837-972f-0d358ebca5bd tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] [instance: c2c661f2-d3da-4357-a7a8-3f85fc94cc60] Going to try to terminate instance {{(pid=123431) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 24 10:48:19.948238 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-bd8b79cd-7699-41e5-b838-35975dabb357 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:48:19.957845 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-bd8b79cd-7699-41e5-b838-35975dabb357 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:48:19.959314 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-bd8b79cd-7699-41e5-b838-35975dabb357 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:48:19.960551 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-bd8b79cd-7699-41e5-b838-35975dabb357 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] 10.222.0.30 "GET /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0" status: 200 len: 1808 microversion: 2.20 time: 0.181822 Dec 24 10:48:19.967315 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 311/603] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Dec 24 10:48:19 2021] GET /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0 => generated 1808 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 24 10:48:20.115376 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-83e6594f-2a70-42e7-b0fd-7e0786b9e755 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:48:20.117129 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-83e6594f-2a70-42e7-b0fd-7e0786b9e755 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] [instance: 9330dbb8-edad-4d54-afeb-8badc464250d] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:48:20.123103 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-83e6594f-2a70-42e7-b0fd-7e0786b9e755 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:20.123544 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-83e6594f-2a70-42e7-b0fd-7e0786b9e755 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:20.124324 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-83e6594f-2a70-42e7-b0fd-7e0786b9e755 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:20.124751 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-83e6594f-2a70-42e7-b0fd-7e0786b9e755 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:20.238940 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-98375bd4-f54a-4837-972f-0d358ebca5bd tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] 10.222.0.30 "DELETE /compute/v2.1/servers/c2c661f2-d3da-4357-a7a8-3f85fc94cc60" status: 204 len: 0 microversion: 2.1 time: 0.487017 Dec 24 10:48:20.240416 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 293/604] 10.222.0.30 () {58 vars in 1238 bytes} [Fri Dec 24 10:48:19 2021] DELETE /compute/v2.1/servers/c2c661f2-d3da-4357-a7a8-3f85fc94cc60 => generated 0 bytes in 489 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 24 10:48:20.248268 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-c0fc4ab8-823f-4a20-a6f4-6d3ce06166a5 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:48:20.249570 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-c0fc4ab8-823f-4a20-a6f4-6d3ce06166a5 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] [instance: c2c661f2-d3da-4357-a7a8-3f85fc94cc60] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:48:20.265729 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-c0fc4ab8-823f-4a20-a6f4-6d3ce06166a5 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:20.266336 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-c0fc4ab8-823f-4a20-a6f4-6d3ce06166a5 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:20.267755 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-c0fc4ab8-823f-4a20-a6f4-6d3ce06166a5 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:20.268314 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-c0fc4ab8-823f-4a20-a6f4-6d3ce06166a5 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:20.318421 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-83e6594f-2a70-42e7-b0fd-7e0786b9e755 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37516225f9244c969ed168f6a024482a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0115a5cc8b4b1e8bffb84e0f3e0b08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:48:20.327229 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-83e6594f-2a70-42e7-b0fd-7e0786b9e755 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] 10.222.0.30 "GET /compute/v2.1/servers/9330dbb8-edad-4d54-afeb-8badc464250d" status: 200 len: 1724 microversion: 2.1 time: 0.215634 Dec 24 10:48:20.348435 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 312/605] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:48:20 2021] GET /compute/v2.1/servers/9330dbb8-edad-4d54-afeb-8badc464250d => generated 1724 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 24 10:48:20.426023 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-c0fc4ab8-823f-4a20-a6f4-6d3ce06166a5 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d627b760f74f48ac560e2ce2e74e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '378bb44ad89440e49f7e290a5d31004e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:48:20.433564 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-c0fc4ab8-823f-4a20-a6f4-6d3ce06166a5 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] 10.222.0.30 "GET /compute/v2.1/servers/c2c661f2-d3da-4357-a7a8-3f85fc94cc60" status: 200 len: 1508 microversion: 2.1 time: 0.189366 Dec 24 10:48:20.434166 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 294/606] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:48:20 2021] GET /compute/v2.1/servers/c2c661f2-d3da-4357-a7a8-3f85fc94cc60 => generated 1508 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 24 10:48:20.456069 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-1152dd0e-d941-4ee2-afa5-671f5dc2678c tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:48:20.456987 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-1152dd0e-d941-4ee2-afa5-671f5dc2678c tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] [instance: fb8d3af9-4513-4f65-8863-0f910fd46f04] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:48:20.463022 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-1152dd0e-d941-4ee2-afa5-671f5dc2678c tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:20.463447 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-1152dd0e-d941-4ee2-afa5-671f5dc2678c tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:20.464224 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-1152dd0e-d941-4ee2-afa5-671f5dc2678c tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:20.464726 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-1152dd0e-d941-4ee2-afa5-671f5dc2678c tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:20.619189 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-1152dd0e-d941-4ee2-afa5-671f5dc2678c tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ad5096717dc425c849dfe95ea55a6af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62d11172cdf4959a15ac1ffc5601aca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:48:20.627723 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-1152dd0e-d941-4ee2-afa5-671f5dc2678c tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] 10.222.0.30 "GET /compute/v2.1/servers/fb8d3af9-4513-4f65-8863-0f910fd46f04" status: 200 len: 1513 microversion: 2.1 time: 0.175813 Dec 24 10:48:20.628340 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 313/607] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:48:20 2021] GET /compute/v2.1/servers/fb8d3af9-4513-4f65-8863-0f910fd46f04 => generated 1513 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:48:20.979380 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-bf9caef5-a6a5-41bf-85c1-83e02e8c9c10 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:48:20.979981 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-bf9caef5-a6a5-41bf-85c1-83e02e8c9c10 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] [instance: a99a6a98-4010-4f8e-a83f-fcc490f6ece0] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:48:20.989073 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-bf9caef5-a6a5-41bf-85c1-83e02e8c9c10 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:20.989519 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-bf9caef5-a6a5-41bf-85c1-83e02e8c9c10 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:20.990316 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-bf9caef5-a6a5-41bf-85c1-83e02e8c9c10 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:20.990748 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-bf9caef5-a6a5-41bf-85c1-83e02e8c9c10 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:21.140870 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-bf9caef5-a6a5-41bf-85c1-83e02e8c9c10 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:48:21.149843 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-bf9caef5-a6a5-41bf-85c1-83e02e8c9c10 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:48:21.151338 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-bf9caef5-a6a5-41bf-85c1-83e02e8c9c10 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:48:21.152488 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-bf9caef5-a6a5-41bf-85c1-83e02e8c9c10 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] 10.222.0.30 "GET /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0" status: 200 len: 1808 microversion: 2.20 time: 0.176933 Dec 24 10:48:21.153124 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 295/608] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Dec 24 10:48:20 2021] GET /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0 => generated 1808 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 10:48:21.324029 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-acbf1d23-0064-4763-a51e-1ffe75a5f046 tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1125894519"}} {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:48:21.324589 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-acbf1d23-0064-4763-a51e-1ffe75a5f046 tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] [instance: 12183d8e-4c50-449a-a93d-cee72f597b3d] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:48:21.331515 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-acbf1d23-0064-4763-a51e-1ffe75a5f046 tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:21.331970 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-acbf1d23-0064-4763-a51e-1ffe75a5f046 tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:21.332756 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-acbf1d23-0064-4763-a51e-1ffe75a5f046 tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:21.333285 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-acbf1d23-0064-4763-a51e-1ffe75a5f046 tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:21.344721 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-6996f1be-5d28-4716-a48a-ffbb87272132 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:48:21.345545 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-6996f1be-5d28-4716-a48a-ffbb87272132 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] [instance: 9330dbb8-edad-4d54-afeb-8badc464250d] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:48:21.351458 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-6996f1be-5d28-4716-a48a-ffbb87272132 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:21.352024 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-6996f1be-5d28-4716-a48a-ffbb87272132 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:21.352904 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-6996f1be-5d28-4716-a48a-ffbb87272132 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:21.353432 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-6996f1be-5d28-4716-a48a-ffbb87272132 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:21.505704 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.network.security_group_api [None req-acbf1d23-0064-4763-a51e-1ffe75a5f046 tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Adding security group 3b8958a9-d372-4911-8d35-3c880723732b to port abebf56e-a643-48ae-a779-897dbd105170 Dec 24 10:48:21.521043 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-6996f1be-5d28-4716-a48a-ffbb87272132 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37516225f9244c969ed168f6a024482a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0115a5cc8b4b1e8bffb84e0f3e0b08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:48:21.530603 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-6996f1be-5d28-4716-a48a-ffbb87272132 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] 10.222.0.30 "GET /compute/v2.1/servers/9330dbb8-edad-4d54-afeb-8badc464250d" status: 200 len: 1724 microversion: 2.1 time: 0.189490 Dec 24 10:48:21.531218 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 296/609] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:48:21 2021] GET /compute/v2.1/servers/9330dbb8-edad-4d54-afeb-8badc464250d => generated 1724 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 24 10:48:21.535584 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-f3eb871b-c5e2-43cf-9d63-dc1d80cbc008 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:48:21.536209 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-f3eb871b-c5e2-43cf-9d63-dc1d80cbc008 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] [instance: c2c661f2-d3da-4357-a7a8-3f85fc94cc60] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:48:21.555340 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-f3eb871b-c5e2-43cf-9d63-dc1d80cbc008 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:21.605558 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-f3eb871b-c5e2-43cf-9d63-dc1d80cbc008 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:21.605558 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-f3eb871b-c5e2-43cf-9d63-dc1d80cbc008 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:21.605558 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-f3eb871b-c5e2-43cf-9d63-dc1d80cbc008 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:21.707639 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-f3eb871b-c5e2-43cf-9d63-dc1d80cbc008 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d627b760f74f48ac560e2ce2e74e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '378bb44ad89440e49f7e290a5d31004e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:48:21.716043 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-f3eb871b-c5e2-43cf-9d63-dc1d80cbc008 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] 10.222.0.30 "GET /compute/v2.1/servers/c2c661f2-d3da-4357-a7a8-3f85fc94cc60" status: 200 len: 1508 microversion: 2.1 time: 0.183562 Dec 24 10:48:21.730584 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 297/610] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:48:21 2021] GET /compute/v2.1/servers/c2c661f2-d3da-4357-a7a8-3f85fc94cc60 => generated 1508 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:48:21.735508 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-28c6cfde-2219-4724-8621-263258336fae tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:48:21.736289 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-28c6cfde-2219-4724-8621-263258336fae tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] [instance: fb8d3af9-4513-4f65-8863-0f910fd46f04] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:48:21.749261 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-28c6cfde-2219-4724-8621-263258336fae tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:21.750730 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-28c6cfde-2219-4724-8621-263258336fae tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:21.751485 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-28c6cfde-2219-4724-8621-263258336fae tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:21.752865 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-28c6cfde-2219-4724-8621-263258336fae tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:22.010124 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-28c6cfde-2219-4724-8621-263258336fae tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ad5096717dc425c849dfe95ea55a6af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62d11172cdf4959a15ac1ffc5601aca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:48:22.018897 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-28c6cfde-2219-4724-8621-263258336fae tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] 10.222.0.30 "GET /compute/v2.1/servers/fb8d3af9-4513-4f65-8863-0f910fd46f04" status: 200 len: 1513 microversion: 2.1 time: 0.287050 Dec 24 10:48:22.019467 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 298/611] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:48:21 2021] GET /compute/v2.1/servers/fb8d3af9-4513-4f65-8863-0f910fd46f04 => generated 1513 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:48:22.171230 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-05f7b5b5-860d-48d3-90b4-dbb4f7fd32d7 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:48:22.171863 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-05f7b5b5-860d-48d3-90b4-dbb4f7fd32d7 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] [instance: a99a6a98-4010-4f8e-a83f-fcc490f6ece0] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:48:22.178471 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-05f7b5b5-860d-48d3-90b4-dbb4f7fd32d7 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:22.178932 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-05f7b5b5-860d-48d3-90b4-dbb4f7fd32d7 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:22.179707 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-05f7b5b5-860d-48d3-90b4-dbb4f7fd32d7 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:22.180136 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-05f7b5b5-860d-48d3-90b4-dbb4f7fd32d7 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:22.357102 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-acbf1d23-0064-4763-a51e-1ffe75a5f046 tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] 10.222.0.30 "POST /compute/v2.1/servers/12183d8e-4c50-449a-a93d-cee72f597b3d/action" status: 202 len: 0 microversion: 2.1 time: 1.036736 Dec 24 10:48:22.358017 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 314/612] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Dec 24 10:48:21 2021] POST /compute/v2.1/servers/12183d8e-4c50-449a-a93d-cee72f597b3d/action => generated 0 bytes in 1038 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 24 10:48:22.366776 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-f2330c1a-1560-4bcb-af93-41558461c78f tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:48:22.367386 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-f2330c1a-1560-4bcb-af93-41558461c78f tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] [instance: 12183d8e-4c50-449a-a93d-cee72f597b3d] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:48:22.384106 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-f2330c1a-1560-4bcb-af93-41558461c78f tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:22.384106 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-f2330c1a-1560-4bcb-af93-41558461c78f tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:22.384106 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-f2330c1a-1560-4bcb-af93-41558461c78f tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:22.384106 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-f2330c1a-1560-4bcb-af93-41558461c78f tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:22.392594 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-05f7b5b5-860d-48d3-90b4-dbb4f7fd32d7 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:48:22.411406 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-05f7b5b5-860d-48d3-90b4-dbb4f7fd32d7 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:48:22.413189 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-05f7b5b5-860d-48d3-90b4-dbb4f7fd32d7 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:48:22.418460 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-05f7b5b5-860d-48d3-90b4-dbb4f7fd32d7 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] 10.222.0.30 "GET /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0" status: 200 len: 1808 microversion: 2.20 time: 0.247084 Dec 24 10:48:22.418460 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 299/613] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Dec 24 10:48:22 2021] GET /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0 => generated 1808 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 10:48:22.420184 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [req-1558f5a6-8f62-4522-a8e4-ac3ff09681ce req-37e8481c-b75b-419d-916c-cb314d8beb31 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "12183d8e-4c50-449a-a93d-cee72f597b3d", "tag": "abebf56e-a643-48ae-a779-897dbd105170"}]} {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:48:22.434979 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 10:48:22.434979 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: warnings.warn(msg) Dec 24 10:48:22.456924 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [req-1558f5a6-8f62-4522-a8e4-ac3ff09681ce req-37e8481c-b75b-419d-916c-cb314d8beb31 service nova] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:22.464517 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [req-1558f5a6-8f62-4522-a8e4-ac3ff09681ce req-37e8481c-b75b-419d-916c-cb314d8beb31 service nova] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:22.488594 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.compute.server_external_events [req-1558f5a6-8f62-4522-a8e4-ac3ff09681ce req-37e8481c-b75b-419d-916c-cb314d8beb31 service nova] Creating event network-changed:abebf56e-a643-48ae-a779-897dbd105170 for instance 12183d8e-4c50-449a-a93d-cee72f597b3d on hv-cinder-81644 Dec 24 10:48:22.511641 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [req-1558f5a6-8f62-4522-a8e4-ac3ff09681ce req-37e8481c-b75b-419d-916c-cb314d8beb31 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092913 Dec 24 10:48:22.512453 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 300/614] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Dec 24 10:48:22 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 10:48:22.549221 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-9fe259c2-87e5-4dee-8a54-08e460fb1991 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:48:22.556165 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-9fe259c2-87e5-4dee-8a54-08e460fb1991 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] [instance: 9330dbb8-edad-4d54-afeb-8badc464250d] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:48:22.558049 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-9fe259c2-87e5-4dee-8a54-08e460fb1991 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:22.558691 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-9fe259c2-87e5-4dee-8a54-08e460fb1991 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:22.559492 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-9fe259c2-87e5-4dee-8a54-08e460fb1991 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:22.559930 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-9fe259c2-87e5-4dee-8a54-08e460fb1991 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:22.599125 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-f2330c1a-1560-4bcb-af93-41558461c78f tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e2194bc8c0d44b186956c1b38a0c04a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed29a38d2fe424398ac10e585a980df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:48:22.613815 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-f2330c1a-1560-4bcb-af93-41558461c78f tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] 10.222.0.30 "GET /compute/v2.1/servers/12183d8e-4c50-449a-a93d-cee72f597b3d" status: 200 len: 1641 microversion: 2.1 time: 0.250523 Dec 24 10:48:22.629305 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 315/615] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:48:22 2021] GET /compute/v2.1/servers/12183d8e-4c50-449a-a93d-cee72f597b3d => generated 1641 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 24 10:48:22.730916 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-9fe259c2-87e5-4dee-8a54-08e460fb1991 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37516225f9244c969ed168f6a024482a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0115a5cc8b4b1e8bffb84e0f3e0b08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:48:22.736492 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-6b7790c8-9822-4b6f-90a5-16d8b7f8c317 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:48:22.737143 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-6b7790c8-9822-4b6f-90a5-16d8b7f8c317 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] [instance: c2c661f2-d3da-4357-a7a8-3f85fc94cc60] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:48:22.740412 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-9fe259c2-87e5-4dee-8a54-08e460fb1991 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] 10.222.0.30 "GET /compute/v2.1/servers/9330dbb8-edad-4d54-afeb-8badc464250d" status: 200 len: 1724 microversion: 2.1 time: 0.196389 Dec 24 10:48:22.742301 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 301/616] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:48:22 2021] GET /compute/v2.1/servers/9330dbb8-edad-4d54-afeb-8badc464250d => generated 1724 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 24 10:48:22.754532 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-6b7790c8-9822-4b6f-90a5-16d8b7f8c317 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:22.755267 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-6b7790c8-9822-4b6f-90a5-16d8b7f8c317 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:22.756269 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-6b7790c8-9822-4b6f-90a5-16d8b7f8c317 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:22.756895 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-6b7790c8-9822-4b6f-90a5-16d8b7f8c317 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:22.910399 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-6b7790c8-9822-4b6f-90a5-16d8b7f8c317 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d627b760f74f48ac560e2ce2e74e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '378bb44ad89440e49f7e290a5d31004e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:48:22.919742 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-6b7790c8-9822-4b6f-90a5-16d8b7f8c317 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] 10.222.0.30 "GET /compute/v2.1/servers/c2c661f2-d3da-4357-a7a8-3f85fc94cc60" status: 200 len: 1508 microversion: 2.1 time: 0.188076 Dec 24 10:48:22.921187 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 316/617] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:48:22 2021] GET /compute/v2.1/servers/c2c661f2-d3da-4357-a7a8-3f85fc94cc60 => generated 1508 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:48:23.036723 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-1213fdbc-4e88-46bc-9506-807ef27eecf5 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:48:23.037561 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-1213fdbc-4e88-46bc-9506-807ef27eecf5 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] [instance: fb8d3af9-4513-4f65-8863-0f910fd46f04] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:48:23.044222 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-1213fdbc-4e88-46bc-9506-807ef27eecf5 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:23.045043 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-1213fdbc-4e88-46bc-9506-807ef27eecf5 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:23.045886 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-1213fdbc-4e88-46bc-9506-807ef27eecf5 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:23.046508 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-1213fdbc-4e88-46bc-9506-807ef27eecf5 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:23.200616 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-1213fdbc-4e88-46bc-9506-807ef27eecf5 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ad5096717dc425c849dfe95ea55a6af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62d11172cdf4959a15ac1ffc5601aca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:48:23.209548 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-1213fdbc-4e88-46bc-9506-807ef27eecf5 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] 10.222.0.30 "GET /compute/v2.1/servers/fb8d3af9-4513-4f65-8863-0f910fd46f04" status: 200 len: 1513 microversion: 2.1 time: 0.175843 Dec 24 10:48:23.209548 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 302/618] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:48:23 2021] GET /compute/v2.1/servers/fb8d3af9-4513-4f65-8863-0f910fd46f04 => generated 1513 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:48:23.427989 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-b56e4ac3-8cb7-4606-81c2-8a35c9b752cc tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-51319987", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-2082088977", "security_groups": [{"name": "tempest-secgroup-smoke-1649720889"}], "block_device_mapping_v2": [{"uuid": "63633061-170a-4ba6-9ad5-20ec39522c20", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "c02b29c7-4d73-429c-95e6-0bbcaa5e122f"}]}} {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:48:23.432755 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-faed30be-c41b-46ed-ab6f-64c4191188ce tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:48:23.434469 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-faed30be-c41b-46ed-ab6f-64c4191188ce tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] [instance: a99a6a98-4010-4f8e-a83f-fcc490f6ece0] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:48:23.441485 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-faed30be-c41b-46ed-ab6f-64c4191188ce tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:23.441948 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-faed30be-c41b-46ed-ab6f-64c4191188ce tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:23.443204 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-faed30be-c41b-46ed-ab6f-64c4191188ce tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:23.443710 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-faed30be-c41b-46ed-ab6f-64c4191188ce tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:23.554646 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.network.neutron [None req-b56e4ac3-8cb7-4606-81c2-8a35c9b752cc tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] validate_networks() for [('c02b29c7-4d73-429c-95e6-0bbcaa5e122f', None, None, None, None, None)] {{(pid=123432) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 24 10:48:23.588591 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-faed30be-c41b-46ed-ab6f-64c4191188ce tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:48:23.597418 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-faed30be-c41b-46ed-ab6f-64c4191188ce tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:48:23.598916 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-faed30be-c41b-46ed-ab6f-64c4191188ce tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:48:23.600073 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-faed30be-c41b-46ed-ab6f-64c4191188ce tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] 10.222.0.30 "GET /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0" status: 200 len: 1808 microversion: 2.20 time: 0.171409 Dec 24 10:48:23.600668 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 303/619] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Dec 24 10:48:23 2021] GET /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0 => generated 1808 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 24 10:48:23.759372 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-71ad92c2-d9cd-4745-9222-d932f69e580f tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:48:23.759981 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-71ad92c2-d9cd-4745-9222-d932f69e580f tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] [instance: 9330dbb8-edad-4d54-afeb-8badc464250d] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:48:23.765913 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-71ad92c2-d9cd-4745-9222-d932f69e580f tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:23.766358 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-71ad92c2-d9cd-4745-9222-d932f69e580f tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:23.767193 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-71ad92c2-d9cd-4745-9222-d932f69e580f tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:23.767621 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-71ad92c2-d9cd-4745-9222-d932f69e580f tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:23.935891 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-71ad92c2-d9cd-4745-9222-d932f69e580f tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37516225f9244c969ed168f6a024482a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0115a5cc8b4b1e8bffb84e0f3e0b08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:48:23.948416 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-71ad92c2-d9cd-4745-9222-d932f69e580f tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] 10.222.0.30 "GET /compute/v2.1/servers/9330dbb8-edad-4d54-afeb-8badc464250d" status: 200 len: 1724 microversion: 2.1 time: 0.192185 Dec 24 10:48:23.949010 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 304/620] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:48:23 2021] GET /compute/v2.1/servers/9330dbb8-edad-4d54-afeb-8badc464250d => generated 1724 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 24 10:48:23.954154 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-61737de0-576a-4725-88be-c4005dbf8d06 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:48:23.955362 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-61737de0-576a-4725-88be-c4005dbf8d06 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] [instance: c2c661f2-d3da-4357-a7a8-3f85fc94cc60] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:48:23.961367 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-61737de0-576a-4725-88be-c4005dbf8d06 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:23.961818 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-61737de0-576a-4725-88be-c4005dbf8d06 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:23.962609 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-61737de0-576a-4725-88be-c4005dbf8d06 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:23.963068 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-61737de0-576a-4725-88be-c4005dbf8d06 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:23.974083 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.virt.hardware [None req-b56e4ac3-8cb7-4606-81c2-8a35c9b752cc tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Flavor limits 0:0:0 {{(pid=123432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 24 10:48:23.974506 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.virt.hardware [None req-b56e4ac3-8cb7-4606-81c2-8a35c9b752cc tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Image limits 0:0:0 {{(pid=123432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 24 10:48:23.974975 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.virt.hardware [None req-b56e4ac3-8cb7-4606-81c2-8a35c9b752cc tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Flavor pref 0:0:0 {{(pid=123432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 24 10:48:23.975390 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.virt.hardware [None req-b56e4ac3-8cb7-4606-81c2-8a35c9b752cc tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Image pref 0:0:0 {{(pid=123432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 24 10:48:23.975842 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.virt.hardware [None req-b56e4ac3-8cb7-4606-81c2-8a35c9b752cc tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 24 10:48:23.999528 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-b56e4ac3-8cb7-4606-81c2-8a35c9b752cc tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:24.000151 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-b56e4ac3-8cb7-4606-81c2-8a35c9b752cc tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:24.001697 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-b56e4ac3-8cb7-4606-81c2-8a35c9b752cc tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:24.002489 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-b56e4ac3-8cb7-4606-81c2-8a35c9b752cc tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:24.020350 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.quota [None req-b56e4ac3-8cb7-4606-81c2-8a35c9b752cc tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Getting quotas for project 9d0fd34670674906aa9a61200251b76c. Resources: {'instances', 'cores', 'ram'} {{(pid=123432) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 24 10:48:24.024799 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.quota [None req-b56e4ac3-8cb7-4606-81c2-8a35c9b752cc tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Getting quotas for user b690a952a1704197baf5e653e27160f2 and project 9d0fd34670674906aa9a61200251b76c. Resources: {'instances', 'cores', 'ram'} {{(pid=123432) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 24 10:48:24.088757 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-b56e4ac3-8cb7-4606-81c2-8a35c9b752cc tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Going to run 1 instances... {{(pid=123432) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 24 10:48:24.091005 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-b56e4ac3-8cb7-4606-81c2-8a35c9b752cc tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] [instance: 91615e87-1e43-4d69-baab-d7af897d1ac3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='63633061-170a-4ba6-9ad5-20ec39522c20',volume_size=None,volume_type=None)] {{(pid=123432) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 24 10:48:24.117754 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-61737de0-576a-4725-88be-c4005dbf8d06 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d627b760f74f48ac560e2ce2e74e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '378bb44ad89440e49f7e290a5d31004e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:48:24.125178 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-61737de0-576a-4725-88be-c4005dbf8d06 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] 10.222.0.30 "GET /compute/v2.1/servers/c2c661f2-d3da-4357-a7a8-3f85fc94cc60" status: 200 len: 1508 microversion: 2.1 time: 0.175113 Dec 24 10:48:24.126032 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 305/621] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:48:23 2021] GET /compute/v2.1/servers/c2c661f2-d3da-4357-a7a8-3f85fc94cc60 => generated 1508 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:48:24.226105 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-0fff4e64-8ba6-4756-9e9b-abcb9d4b679f tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:48:24.226700 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-0fff4e64-8ba6-4756-9e9b-abcb9d4b679f tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] [instance: fb8d3af9-4513-4f65-8863-0f910fd46f04] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:48:24.232620 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-0fff4e64-8ba6-4756-9e9b-abcb9d4b679f tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:24.233077 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-0fff4e64-8ba6-4756-9e9b-abcb9d4b679f tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:24.233844 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-0fff4e64-8ba6-4756-9e9b-abcb9d4b679f tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:24.234273 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-0fff4e64-8ba6-4756-9e9b-abcb9d4b679f tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:24.379484 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-0fff4e64-8ba6-4756-9e9b-abcb9d4b679f tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ad5096717dc425c849dfe95ea55a6af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62d11172cdf4959a15ac1ffc5601aca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:48:24.387069 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-0fff4e64-8ba6-4756-9e9b-abcb9d4b679f tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] 10.222.0.30 "GET /compute/v2.1/servers/fb8d3af9-4513-4f65-8863-0f910fd46f04" status: 200 len: 1513 microversion: 2.1 time: 0.164596 Dec 24 10:48:24.387637 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 306/622] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:48:24 2021] GET /compute/v2.1/servers/fb8d3af9-4513-4f65-8863-0f910fd46f04 => generated 1513 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 24 10:48:24.600027 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-b56e4ac3-8cb7-4606-81c2-8a35c9b752cc tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.175834 Dec 24 10:48:24.601372 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 317/623] 10.222.0.30 () {60 vars in 1146 bytes} [Fri Dec 24 10:48:23 2021] POST /compute/v2.1/servers => generated 406 bytes in 1177 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 24 10:48:24.611501 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-0dfced58-3c75-416d-8d31-de0d786fbcb7 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:48:24.612209 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-0dfced58-3c75-416d-8d31-de0d786fbcb7 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] [instance: 91615e87-1e43-4d69-baab-d7af897d1ac3] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:48:24.620032 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-57952b38-d329-45d4-9248-28fac446cd95 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:48:24.620666 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-57952b38-d329-45d4-9248-28fac446cd95 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] [instance: a99a6a98-4010-4f8e-a83f-fcc490f6ece0] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:48:24.629197 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-57952b38-d329-45d4-9248-28fac446cd95 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:24.629570 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-57952b38-d329-45d4-9248-28fac446cd95 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:24.630373 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-57952b38-d329-45d4-9248-28fac446cd95 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:24.630812 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-57952b38-d329-45d4-9248-28fac446cd95 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:24.680335 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-0dfced58-3c75-416d-8d31-de0d786fbcb7 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b690a952a1704197baf5e653e27160f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0fd34670674906aa9a61200251b76c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:48:24.687496 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-0dfced58-3c75-416d-8d31-de0d786fbcb7 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] 10.222.0.30 "GET /compute/v2.1/servers/91615e87-1e43-4d69-baab-d7af897d1ac3" status: 200 len: 1093 microversion: 2.1 time: 0.080534 Dec 24 10:48:24.697768 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 307/624] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:48:24 2021] GET /compute/v2.1/servers/91615e87-1e43-4d69-baab-d7af897d1ac3 => generated 1093 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:48:24.809496 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-57952b38-d329-45d4-9248-28fac446cd95 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:48:24.821180 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-57952b38-d329-45d4-9248-28fac446cd95 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:48:24.822725 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-57952b38-d329-45d4-9248-28fac446cd95 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:48:24.823937 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-57952b38-d329-45d4-9248-28fac446cd95 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] 10.222.0.30 "GET /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0" status: 200 len: 1808 microversion: 2.20 time: 0.208157 Dec 24 10:48:24.824507 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 318/625] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Dec 24 10:48:24 2021] GET /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0 => generated 1808 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 10:48:24.965810 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-26515b84-f0c3-49ac-842f-16908f386841 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:48:24.966412 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-26515b84-f0c3-49ac-842f-16908f386841 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] [instance: 9330dbb8-edad-4d54-afeb-8badc464250d] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:48:24.973131 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-26515b84-f0c3-49ac-842f-16908f386841 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:24.976947 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-26515b84-f0c3-49ac-842f-16908f386841 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:24.976947 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-26515b84-f0c3-49ac-842f-16908f386841 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:24.976947 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-26515b84-f0c3-49ac-842f-16908f386841 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:25.121579 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-26515b84-f0c3-49ac-842f-16908f386841 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37516225f9244c969ed168f6a024482a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0115a5cc8b4b1e8bffb84e0f3e0b08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:48:25.131910 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-26515b84-f0c3-49ac-842f-16908f386841 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] 10.222.0.30 "GET /compute/v2.1/servers/9330dbb8-edad-4d54-afeb-8badc464250d" status: 200 len: 1724 microversion: 2.1 time: 0.168357 Dec 24 10:48:25.131910 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 308/626] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:48:24 2021] GET /compute/v2.1/servers/9330dbb8-edad-4d54-afeb-8badc464250d => generated 1724 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:48:25.141532 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-b41b7d45-a463-4b09-b0d7-7a347966f54a tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:48:25.142169 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-b41b7d45-a463-4b09-b0d7-7a347966f54a tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] [instance: c2c661f2-d3da-4357-a7a8-3f85fc94cc60] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:48:25.148499 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-b41b7d45-a463-4b09-b0d7-7a347966f54a tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:25.148930 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-b41b7d45-a463-4b09-b0d7-7a347966f54a tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:25.149733 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-b41b7d45-a463-4b09-b0d7-7a347966f54a tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:25.150150 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-b41b7d45-a463-4b09-b0d7-7a347966f54a tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:25.302345 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-b41b7d45-a463-4b09-b0d7-7a347966f54a tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d627b760f74f48ac560e2ce2e74e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '378bb44ad89440e49f7e290a5d31004e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:48:25.309847 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-b41b7d45-a463-4b09-b0d7-7a347966f54a tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] 10.222.0.30 "GET /compute/v2.1/servers/c2c661f2-d3da-4357-a7a8-3f85fc94cc60" status: 200 len: 1508 microversion: 2.1 time: 0.172004 Dec 24 10:48:25.310406 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 319/627] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:48:25 2021] GET /compute/v2.1/servers/c2c661f2-d3da-4357-a7a8-3f85fc94cc60 => generated 1508 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:48:25.403805 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-69a2beef-a9e9-48fe-a253-cbcee9383ac0 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:48:25.404702 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-69a2beef-a9e9-48fe-a253-cbcee9383ac0 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] [instance: fb8d3af9-4513-4f65-8863-0f910fd46f04] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:48:25.418069 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-69a2beef-a9e9-48fe-a253-cbcee9383ac0 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:25.426817 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-69a2beef-a9e9-48fe-a253-cbcee9383ac0 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:25.426817 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-69a2beef-a9e9-48fe-a253-cbcee9383ac0 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:25.426817 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-69a2beef-a9e9-48fe-a253-cbcee9383ac0 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:25.574562 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-69a2beef-a9e9-48fe-a253-cbcee9383ac0 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ad5096717dc425c849dfe95ea55a6af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62d11172cdf4959a15ac1ffc5601aca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:48:25.582994 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-69a2beef-a9e9-48fe-a253-cbcee9383ac0 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] 10.222.0.30 "GET /compute/v2.1/servers/fb8d3af9-4513-4f65-8863-0f910fd46f04" status: 200 len: 1513 microversion: 2.1 time: 0.182886 Dec 24 10:48:25.589098 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 309/628] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:48:25 2021] GET /compute/v2.1/servers/fb8d3af9-4513-4f65-8863-0f910fd46f04 => generated 1513 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:48:25.705946 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-c642bbf5-21a6-48ff-98e8-c0c42b99acea tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:48:25.706606 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-c642bbf5-21a6-48ff-98e8-c0c42b99acea tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] [instance: 91615e87-1e43-4d69-baab-d7af897d1ac3] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:48:25.761362 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-c642bbf5-21a6-48ff-98e8-c0c42b99acea tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b690a952a1704197baf5e653e27160f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0fd34670674906aa9a61200251b76c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:48:25.768774 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-c642bbf5-21a6-48ff-98e8-c0c42b99acea tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] 10.222.0.30 "GET /compute/v2.1/servers/91615e87-1e43-4d69-baab-d7af897d1ac3" status: 200 len: 1093 microversion: 2.1 time: 0.067345 Dec 24 10:48:25.769376 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 320/629] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:48:25 2021] GET /compute/v2.1/servers/91615e87-1e43-4d69-baab-d7af897d1ac3 => generated 1093 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:48:25.842261 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-57830923-6f49-4314-851b-55f1e5fb7b7e tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:48:25.842955 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-57830923-6f49-4314-851b-55f1e5fb7b7e tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] [instance: a99a6a98-4010-4f8e-a83f-fcc490f6ece0] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:48:25.849662 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-57830923-6f49-4314-851b-55f1e5fb7b7e tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:25.850219 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-57830923-6f49-4314-851b-55f1e5fb7b7e tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:25.851085 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-57830923-6f49-4314-851b-55f1e5fb7b7e tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:25.851591 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-57830923-6f49-4314-851b-55f1e5fb7b7e tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:25.995502 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-57830923-6f49-4314-851b-55f1e5fb7b7e tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:48:26.004194 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-57830923-6f49-4314-851b-55f1e5fb7b7e tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:48:26.005716 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-57830923-6f49-4314-851b-55f1e5fb7b7e tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:48:26.006947 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-57830923-6f49-4314-851b-55f1e5fb7b7e tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] 10.222.0.30 "GET /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0" status: 200 len: 1808 microversion: 2.20 time: 0.168511 Dec 24 10:48:26.007574 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 310/630] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Dec 24 10:48:25 2021] GET /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0 => generated 1808 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 10:48:26.148219 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-bfdb1bbd-f5be-49c7-b10a-e86c3c2ca563 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:48:26.148841 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-bfdb1bbd-f5be-49c7-b10a-e86c3c2ca563 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] [instance: 9330dbb8-edad-4d54-afeb-8badc464250d] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:48:26.155987 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-bfdb1bbd-f5be-49c7-b10a-e86c3c2ca563 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:26.156532 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-bfdb1bbd-f5be-49c7-b10a-e86c3c2ca563 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:26.157914 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-bfdb1bbd-f5be-49c7-b10a-e86c3c2ca563 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:26.158359 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-bfdb1bbd-f5be-49c7-b10a-e86c3c2ca563 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:26.289879 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-bfdb1bbd-f5be-49c7-b10a-e86c3c2ca563 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37516225f9244c969ed168f6a024482a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0115a5cc8b4b1e8bffb84e0f3e0b08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:48:26.298915 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-bfdb1bbd-f5be-49c7-b10a-e86c3c2ca563 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] 10.222.0.30 "GET /compute/v2.1/servers/9330dbb8-edad-4d54-afeb-8badc464250d" status: 200 len: 1724 microversion: 2.1 time: 0.154695 Dec 24 10:48:26.299827 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 321/631] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:48:26 2021] GET /compute/v2.1/servers/9330dbb8-edad-4d54-afeb-8badc464250d => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:48:26.328039 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-1919b890-2d79-448c-94a1-4ac9a8c61534 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:48:26.328640 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-1919b890-2d79-448c-94a1-4ac9a8c61534 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] [instance: c2c661f2-d3da-4357-a7a8-3f85fc94cc60] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:48:26.335642 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-1919b890-2d79-448c-94a1-4ac9a8c61534 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:26.336083 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-1919b890-2d79-448c-94a1-4ac9a8c61534 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:26.337420 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-1919b890-2d79-448c-94a1-4ac9a8c61534 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:26.337420 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-1919b890-2d79-448c-94a1-4ac9a8c61534 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:26.475958 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-1919b890-2d79-448c-94a1-4ac9a8c61534 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d627b760f74f48ac560e2ce2e74e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '378bb44ad89440e49f7e290a5d31004e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:48:26.483675 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-1919b890-2d79-448c-94a1-4ac9a8c61534 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] 10.222.0.30 "GET /compute/v2.1/servers/c2c661f2-d3da-4357-a7a8-3f85fc94cc60" status: 200 len: 1508 microversion: 2.1 time: 0.159325 Dec 24 10:48:26.484254 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 311/632] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:48:26 2021] GET /compute/v2.1/servers/c2c661f2-d3da-4357-a7a8-3f85fc94cc60 => generated 1508 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:48:26.599314 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-441d15b6-2266-410b-af2a-790096b28526 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:48:26.599848 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-441d15b6-2266-410b-af2a-790096b28526 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] [instance: fb8d3af9-4513-4f65-8863-0f910fd46f04] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:48:26.605840 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-441d15b6-2266-410b-af2a-790096b28526 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:26.606290 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-441d15b6-2266-410b-af2a-790096b28526 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:26.607072 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-441d15b6-2266-410b-af2a-790096b28526 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:26.607507 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-441d15b6-2266-410b-af2a-790096b28526 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:26.757068 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-441d15b6-2266-410b-af2a-790096b28526 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ad5096717dc425c849dfe95ea55a6af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62d11172cdf4959a15ac1ffc5601aca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:48:26.764451 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-441d15b6-2266-410b-af2a-790096b28526 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] 10.222.0.30 "GET /compute/v2.1/servers/fb8d3af9-4513-4f65-8863-0f910fd46f04" status: 200 len: 1513 microversion: 2.1 time: 0.168810 Dec 24 10:48:26.768516 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 322/633] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:48:26 2021] GET /compute/v2.1/servers/fb8d3af9-4513-4f65-8863-0f910fd46f04 => generated 1513 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:48:26.785590 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-caaa8013-261c-4226-a756-ccbd107cded4 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:48:26.786218 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-caaa8013-261c-4226-a756-ccbd107cded4 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] [instance: 91615e87-1e43-4d69-baab-d7af897d1ac3] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:48:26.792526 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-caaa8013-261c-4226-a756-ccbd107cded4 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:26.793026 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-caaa8013-261c-4226-a756-ccbd107cded4 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:26.793803 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-caaa8013-261c-4226-a756-ccbd107cded4 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:26.794231 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-caaa8013-261c-4226-a756-ccbd107cded4 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:26.863800 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-caaa8013-261c-4226-a756-ccbd107cded4 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b690a952a1704197baf5e653e27160f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0fd34670674906aa9a61200251b76c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:48:26.871677 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-caaa8013-261c-4226-a756-ccbd107cded4 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] 10.222.0.30 "GET /compute/v2.1/servers/91615e87-1e43-4d69-baab-d7af897d1ac3" status: 200 len: 1143 microversion: 2.1 time: 0.089684 Dec 24 10:48:26.872267 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 312/634] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:48:26 2021] GET /compute/v2.1/servers/91615e87-1e43-4d69-baab-d7af897d1ac3 => generated 1143 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:48:27.026600 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-32da96dc-b3be-40d0-90f7-36130c228136 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:48:27.027207 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-32da96dc-b3be-40d0-90f7-36130c228136 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] [instance: a99a6a98-4010-4f8e-a83f-fcc490f6ece0] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:48:27.033570 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-32da96dc-b3be-40d0-90f7-36130c228136 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:27.034016 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-32da96dc-b3be-40d0-90f7-36130c228136 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:27.034814 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-32da96dc-b3be-40d0-90f7-36130c228136 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:27.035540 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-32da96dc-b3be-40d0-90f7-36130c228136 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:27.174646 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-32da96dc-b3be-40d0-90f7-36130c228136 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:48:27.183403 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-32da96dc-b3be-40d0-90f7-36130c228136 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:48:27.184908 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-32da96dc-b3be-40d0-90f7-36130c228136 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:48:27.186059 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-32da96dc-b3be-40d0-90f7-36130c228136 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] 10.222.0.30 "GET /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0" status: 200 len: 1808 microversion: 2.20 time: 0.163701 Dec 24 10:48:27.186614 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 323/635] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Dec 24 10:48:27 2021] GET /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0 => generated 1808 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 10:48:27.316446 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-6cf6a5f6-4a96-4434-8948-bf971ac7a425 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:48:27.348123 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-6cf6a5f6-4a96-4434-8948-bf971ac7a425 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] [instance: 9330dbb8-edad-4d54-afeb-8badc464250d] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:48:27.348123 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-6cf6a5f6-4a96-4434-8948-bf971ac7a425 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:27.348123 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-6cf6a5f6-4a96-4434-8948-bf971ac7a425 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:27.348123 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-6cf6a5f6-4a96-4434-8948-bf971ac7a425 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:27.348634 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-6cf6a5f6-4a96-4434-8948-bf971ac7a425 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:27.466769 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-6cf6a5f6-4a96-4434-8948-bf971ac7a425 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37516225f9244c969ed168f6a024482a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0115a5cc8b4b1e8bffb84e0f3e0b08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:48:27.476130 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-6cf6a5f6-4a96-4434-8948-bf971ac7a425 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] 10.222.0.30 "GET /compute/v2.1/servers/9330dbb8-edad-4d54-afeb-8badc464250d" status: 200 len: 1724 microversion: 2.1 time: 0.164057 Dec 24 10:48:27.476750 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 313/636] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:48:27 2021] GET /compute/v2.1/servers/9330dbb8-edad-4d54-afeb-8badc464250d => generated 1724 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:48:27.501211 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-64a1fd18-6bec-48af-b3e5-9f309be6c3c0 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:48:27.501852 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-64a1fd18-6bec-48af-b3e5-9f309be6c3c0 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] [instance: c2c661f2-d3da-4357-a7a8-3f85fc94cc60] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:48:27.507928 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-64a1fd18-6bec-48af-b3e5-9f309be6c3c0 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:27.508373 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-64a1fd18-6bec-48af-b3e5-9f309be6c3c0 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:27.509177 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-64a1fd18-6bec-48af-b3e5-9f309be6c3c0 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:27.509612 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-64a1fd18-6bec-48af-b3e5-9f309be6c3c0 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:27.647470 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-64a1fd18-6bec-48af-b3e5-9f309be6c3c0 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d627b760f74f48ac560e2ce2e74e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '378bb44ad89440e49f7e290a5d31004e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:48:27.654631 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-64a1fd18-6bec-48af-b3e5-9f309be6c3c0 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] 10.222.0.30 "GET /compute/v2.1/servers/c2c661f2-d3da-4357-a7a8-3f85fc94cc60" status: 200 len: 1508 microversion: 2.1 time: 0.157253 Dec 24 10:48:27.655222 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 324/637] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:48:27 2021] GET /compute/v2.1/servers/c2c661f2-d3da-4357-a7a8-3f85fc94cc60 => generated 1508 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:48:27.780690 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-226b8d71-36b9-4cf3-92ae-bf2b073c285f tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:48:27.781232 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-226b8d71-36b9-4cf3-92ae-bf2b073c285f tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] [instance: fb8d3af9-4513-4f65-8863-0f910fd46f04] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:48:27.787011 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-226b8d71-36b9-4cf3-92ae-bf2b073c285f tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:27.787446 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-226b8d71-36b9-4cf3-92ae-bf2b073c285f tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:27.788200 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-226b8d71-36b9-4cf3-92ae-bf2b073c285f tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:27.788623 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-226b8d71-36b9-4cf3-92ae-bf2b073c285f tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:27.888742 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-4238be4f-af27-4f7d-9f3c-796236939887 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:48:27.890037 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-4238be4f-af27-4f7d-9f3c-796236939887 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] [instance: 91615e87-1e43-4d69-baab-d7af897d1ac3] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:48:27.900591 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-4238be4f-af27-4f7d-9f3c-796236939887 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:27.901364 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-4238be4f-af27-4f7d-9f3c-796236939887 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:27.902348 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-4238be4f-af27-4f7d-9f3c-796236939887 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:27.902776 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-4238be4f-af27-4f7d-9f3c-796236939887 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:27.931310 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-226b8d71-36b9-4cf3-92ae-bf2b073c285f tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ad5096717dc425c849dfe95ea55a6af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62d11172cdf4959a15ac1ffc5601aca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:48:27.939620 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-226b8d71-36b9-4cf3-92ae-bf2b073c285f tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] 10.222.0.30 "GET /compute/v2.1/servers/fb8d3af9-4513-4f65-8863-0f910fd46f04" status: 200 len: 1513 microversion: 2.1 time: 0.162572 Dec 24 10:48:27.940207 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 314/638] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:48:27 2021] GET /compute/v2.1/servers/fb8d3af9-4513-4f65-8863-0f910fd46f04 => generated 1513 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:48:27.967849 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-4238be4f-af27-4f7d-9f3c-796236939887 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b690a952a1704197baf5e653e27160f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0fd34670674906aa9a61200251b76c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:48:27.978527 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-4238be4f-af27-4f7d-9f3c-796236939887 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] 10.222.0.30 "GET /compute/v2.1/servers/91615e87-1e43-4d69-baab-d7af897d1ac3" status: 200 len: 1143 microversion: 2.1 time: 0.093275 Dec 24 10:48:27.983746 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 325/639] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:48:27 2021] GET /compute/v2.1/servers/91615e87-1e43-4d69-baab-d7af897d1ac3 => generated 1143 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:48:28.204347 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-5d93c49d-525a-43e9-887b-798635434dc1 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:48:28.204966 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-5d93c49d-525a-43e9-887b-798635434dc1 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] [instance: a99a6a98-4010-4f8e-a83f-fcc490f6ece0] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:48:28.210664 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-5d93c49d-525a-43e9-887b-798635434dc1 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:28.211095 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-5d93c49d-525a-43e9-887b-798635434dc1 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:28.213865 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-5d93c49d-525a-43e9-887b-798635434dc1 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:28.213865 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-5d93c49d-525a-43e9-887b-798635434dc1 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:28.348953 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-5d93c49d-525a-43e9-887b-798635434dc1 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:48:28.358103 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-5d93c49d-525a-43e9-887b-798635434dc1 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:48:28.359589 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-5d93c49d-525a-43e9-887b-798635434dc1 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:48:28.361272 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-5d93c49d-525a-43e9-887b-798635434dc1 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] 10.222.0.30 "GET /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0" status: 200 len: 1808 microversion: 2.20 time: 0.160553 Dec 24 10:48:28.361834 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 315/640] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Dec 24 10:48:28 2021] GET /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0 => generated 1808 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 10:48:28.494183 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-365c3b2f-0ed4-4226-abb3-209052ec4fac tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:48:28.495054 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-365c3b2f-0ed4-4226-abb3-209052ec4fac tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] [instance: 9330dbb8-edad-4d54-afeb-8badc464250d] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:48:28.502150 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-365c3b2f-0ed4-4226-abb3-209052ec4fac tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:28.502695 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-365c3b2f-0ed4-4226-abb3-209052ec4fac tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:28.503834 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-365c3b2f-0ed4-4226-abb3-209052ec4fac tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:28.504362 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-365c3b2f-0ed4-4226-abb3-209052ec4fac tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:28.634346 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-365c3b2f-0ed4-4226-abb3-209052ec4fac tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37516225f9244c969ed168f6a024482a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0115a5cc8b4b1e8bffb84e0f3e0b08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:48:28.642316 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-365c3b2f-0ed4-4226-abb3-209052ec4fac tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] 10.222.0.30 "GET /compute/v2.1/servers/9330dbb8-edad-4d54-afeb-8badc464250d" status: 200 len: 1724 microversion: 2.1 time: 0.151970 Dec 24 10:48:28.643084 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 326/641] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:48:28 2021] GET /compute/v2.1/servers/9330dbb8-edad-4d54-afeb-8badc464250d => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:48:28.671234 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-cb17e231-b612-498c-a046-b79a659db807 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:48:28.671853 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-cb17e231-b612-498c-a046-b79a659db807 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] [instance: c2c661f2-d3da-4357-a7a8-3f85fc94cc60] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:48:28.678183 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-cb17e231-b612-498c-a046-b79a659db807 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:28.681234 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-cb17e231-b612-498c-a046-b79a659db807 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:28.681234 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-cb17e231-b612-498c-a046-b79a659db807 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:28.681234 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-cb17e231-b612-498c-a046-b79a659db807 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:28.809858 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-cb17e231-b612-498c-a046-b79a659db807 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d627b760f74f48ac560e2ce2e74e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '378bb44ad89440e49f7e290a5d31004e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:48:28.817602 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-cb17e231-b612-498c-a046-b79a659db807 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] 10.222.0.30 "GET /compute/v2.1/servers/c2c661f2-d3da-4357-a7a8-3f85fc94cc60" status: 200 len: 1508 microversion: 2.1 time: 0.150054 Dec 24 10:48:28.818240 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 316/642] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:48:28 2021] GET /compute/v2.1/servers/c2c661f2-d3da-4357-a7a8-3f85fc94cc60 => generated 1508 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:48:28.955477 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-3c90f1a5-c426-4fed-bc5a-9891475d025a tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:48:28.956330 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-3c90f1a5-c426-4fed-bc5a-9891475d025a tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] [instance: fb8d3af9-4513-4f65-8863-0f910fd46f04] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:48:28.965371 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-3c90f1a5-c426-4fed-bc5a-9891475d025a tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:28.965371 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-3c90f1a5-c426-4fed-bc5a-9891475d025a tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:28.965371 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-3c90f1a5-c426-4fed-bc5a-9891475d025a tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:28.965371 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-3c90f1a5-c426-4fed-bc5a-9891475d025a tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:28.995467 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-14e49005-1938-4004-8243-d0005d2e8606 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:48:28.996144 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-14e49005-1938-4004-8243-d0005d2e8606 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] [instance: 91615e87-1e43-4d69-baab-d7af897d1ac3] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:48:29.002855 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-14e49005-1938-4004-8243-d0005d2e8606 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:29.005452 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-14e49005-1938-4004-8243-d0005d2e8606 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:29.005452 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-14e49005-1938-4004-8243-d0005d2e8606 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:29.005452 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-14e49005-1938-4004-8243-d0005d2e8606 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:29.066123 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-14e49005-1938-4004-8243-d0005d2e8606 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b690a952a1704197baf5e653e27160f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0fd34670674906aa9a61200251b76c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:48:29.073315 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-14e49005-1938-4004-8243-d0005d2e8606 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] 10.222.0.30 "GET /compute/v2.1/servers/91615e87-1e43-4d69-baab-d7af897d1ac3" status: 200 len: 1143 microversion: 2.1 time: 0.081624 Dec 24 10:48:29.074107 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 317/643] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:48:28 2021] GET /compute/v2.1/servers/91615e87-1e43-4d69-baab-d7af897d1ac3 => generated 1143 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 24 10:48:29.104256 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-3c90f1a5-c426-4fed-bc5a-9891475d025a tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ad5096717dc425c849dfe95ea55a6af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62d11172cdf4959a15ac1ffc5601aca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:48:29.112359 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-3c90f1a5-c426-4fed-bc5a-9891475d025a tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] 10.222.0.30 "GET /compute/v2.1/servers/fb8d3af9-4513-4f65-8863-0f910fd46f04" status: 200 len: 1513 microversion: 2.1 time: 0.160689 Dec 24 10:48:29.112986 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 327/644] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:48:28 2021] GET /compute/v2.1/servers/fb8d3af9-4513-4f65-8863-0f910fd46f04 => generated 1513 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:48:29.382168 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-48afcbdc-4726-44de-a4f6-00f9f4209bc3 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:48:29.382773 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-48afcbdc-4726-44de-a4f6-00f9f4209bc3 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] [instance: a99a6a98-4010-4f8e-a83f-fcc490f6ece0] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:48:29.389953 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-48afcbdc-4726-44de-a4f6-00f9f4209bc3 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:29.390403 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-48afcbdc-4726-44de-a4f6-00f9f4209bc3 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:29.391202 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-48afcbdc-4726-44de-a4f6-00f9f4209bc3 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:29.391675 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-48afcbdc-4726-44de-a4f6-00f9f4209bc3 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:29.536478 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-48afcbdc-4726-44de-a4f6-00f9f4209bc3 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:48:29.545508 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-48afcbdc-4726-44de-a4f6-00f9f4209bc3 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:48:29.547120 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-48afcbdc-4726-44de-a4f6-00f9f4209bc3 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:48:29.548942 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-48afcbdc-4726-44de-a4f6-00f9f4209bc3 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] 10.222.0.30 "GET /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0" status: 200 len: 1808 microversion: 2.20 time: 0.171435 Dec 24 10:48:29.549597 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 318/645] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Dec 24 10:48:29 2021] GET /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0 => generated 1808 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 10:48:29.662874 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-e7b7d49b-3859-440f-81cb-bd092a899f5f tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:48:29.664799 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-e7b7d49b-3859-440f-81cb-bd092a899f5f tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] [instance: 9330dbb8-edad-4d54-afeb-8badc464250d] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:48:29.669582 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-e7b7d49b-3859-440f-81cb-bd092a899f5f tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:29.670051 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-e7b7d49b-3859-440f-81cb-bd092a899f5f tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:29.670815 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-e7b7d49b-3859-440f-81cb-bd092a899f5f tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:29.671238 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-e7b7d49b-3859-440f-81cb-bd092a899f5f tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:29.835444 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-62ccb507-1af2-4bec-af79-d9e5b05ec329 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:48:29.836040 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-62ccb507-1af2-4bec-af79-d9e5b05ec329 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] [instance: c2c661f2-d3da-4357-a7a8-3f85fc94cc60] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:48:29.841902 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-62ccb507-1af2-4bec-af79-d9e5b05ec329 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:29.842344 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-62ccb507-1af2-4bec-af79-d9e5b05ec329 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:29.843124 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-62ccb507-1af2-4bec-af79-d9e5b05ec329 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:29.843554 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-62ccb507-1af2-4bec-af79-d9e5b05ec329 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:29.976443 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-62ccb507-1af2-4bec-af79-d9e5b05ec329 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d627b760f74f48ac560e2ce2e74e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '378bb44ad89440e49f7e290a5d31004e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:48:29.983802 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-62ccb507-1af2-4bec-af79-d9e5b05ec329 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] 10.222.0.30 "GET /compute/v2.1/servers/c2c661f2-d3da-4357-a7a8-3f85fc94cc60" status: 200 len: 1508 microversion: 2.1 time: 0.152070 Dec 24 10:48:29.984394 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 319/646] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:48:29 2021] GET /compute/v2.1/servers/c2c661f2-d3da-4357-a7a8-3f85fc94cc60 => generated 1508 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 24 10:48:30.009852 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-e7b7d49b-3859-440f-81cb-bd092a899f5f tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37516225f9244c969ed168f6a024482a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0115a5cc8b4b1e8bffb84e0f3e0b08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:48:30.018505 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-e7b7d49b-3859-440f-81cb-bd092a899f5f tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] 10.222.0.30 "GET /compute/v2.1/servers/9330dbb8-edad-4d54-afeb-8badc464250d" status: 200 len: 1724 microversion: 2.1 time: 0.359203 Dec 24 10:48:30.019199 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 328/647] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:48:29 2021] GET /compute/v2.1/servers/9330dbb8-edad-4d54-afeb-8badc464250d => generated 1724 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:48:30.090534 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-c14d7278-d0cc-4927-8aa0-d9c095d2b06d tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:48:30.091234 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-c14d7278-d0cc-4927-8aa0-d9c095d2b06d tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] [instance: 91615e87-1e43-4d69-baab-d7af897d1ac3] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:48:30.097950 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-c14d7278-d0cc-4927-8aa0-d9c095d2b06d tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:30.098500 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-c14d7278-d0cc-4927-8aa0-d9c095d2b06d tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:30.099753 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-c14d7278-d0cc-4927-8aa0-d9c095d2b06d tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:30.100253 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-c14d7278-d0cc-4927-8aa0-d9c095d2b06d tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:30.129544 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-4c1b4210-6e7a-4ca5-ab89-2f75c3c9350a tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:48:30.130205 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-4c1b4210-6e7a-4ca5-ab89-2f75c3c9350a tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] [instance: fb8d3af9-4513-4f65-8863-0f910fd46f04] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:48:30.136425 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-4c1b4210-6e7a-4ca5-ab89-2f75c3c9350a tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:30.136890 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-4c1b4210-6e7a-4ca5-ab89-2f75c3c9350a tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:30.137701 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-4c1b4210-6e7a-4ca5-ab89-2f75c3c9350a tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:30.138156 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-4c1b4210-6e7a-4ca5-ab89-2f75c3c9350a tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:30.161905 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-c14d7278-d0cc-4927-8aa0-d9c095d2b06d tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b690a952a1704197baf5e653e27160f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0fd34670674906aa9a61200251b76c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:48:30.169509 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-c14d7278-d0cc-4927-8aa0-d9c095d2b06d tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] 10.222.0.30 "GET /compute/v2.1/servers/91615e87-1e43-4d69-baab-d7af897d1ac3" status: 200 len: 1191 microversion: 2.1 time: 0.083493 Dec 24 10:48:30.170091 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 320/648] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:48:30 2021] GET /compute/v2.1/servers/91615e87-1e43-4d69-baab-d7af897d1ac3 => generated 1191 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:48:30.429413 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-4c1b4210-6e7a-4ca5-ab89-2f75c3c9350a tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ad5096717dc425c849dfe95ea55a6af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62d11172cdf4959a15ac1ffc5601aca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:48:30.436892 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-4c1b4210-6e7a-4ca5-ab89-2f75c3c9350a tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] 10.222.0.30 "GET /compute/v2.1/servers/fb8d3af9-4513-4f65-8863-0f910fd46f04" status: 200 len: 1513 microversion: 2.1 time: 0.311792 Dec 24 10:48:30.437550 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 329/649] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:48:30 2021] GET /compute/v2.1/servers/fb8d3af9-4513-4f65-8863-0f910fd46f04 => generated 1513 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 24 10:48:30.567929 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-f0e065d8-6e19-488b-a4c8-9d06a521f174 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:48:30.568443 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-f0e065d8-6e19-488b-a4c8-9d06a521f174 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] [instance: a99a6a98-4010-4f8e-a83f-fcc490f6ece0] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:48:30.574607 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-f0e065d8-6e19-488b-a4c8-9d06a521f174 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:30.575046 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-f0e065d8-6e19-488b-a4c8-9d06a521f174 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:30.575812 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-f0e065d8-6e19-488b-a4c8-9d06a521f174 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:30.576239 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-f0e065d8-6e19-488b-a4c8-9d06a521f174 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:30.742777 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-f0e065d8-6e19-488b-a4c8-9d06a521f174 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:48:30.758295 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-f0e065d8-6e19-488b-a4c8-9d06a521f174 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:48:30.760148 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-f0e065d8-6e19-488b-a4c8-9d06a521f174 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:48:30.761781 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-f0e065d8-6e19-488b-a4c8-9d06a521f174 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] 10.222.0.30 "GET /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0" status: 200 len: 1808 microversion: 2.20 time: 0.198170 Dec 24 10:48:30.763282 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 321/650] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Dec 24 10:48:30 2021] GET /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0 => generated 1808 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 10:48:30.772087 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [req-d7202305-0e7a-45ee-b27e-df1251647457 req-0e957019-3ccc-4da6-9fcc-e1edbfa8fbe5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb8d3af9-4513-4f65-8863-0f910fd46f04", "name": "network-vif-deleted", "tag": "eb607d9e-2e93-47a0-8ad5-4d68c6faaa44"}]} {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:48:30.777990 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 10:48:30.777990 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: warnings.warn(msg) Dec 24 10:48:30.787221 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [req-d7202305-0e7a-45ee-b27e-df1251647457 req-0e957019-3ccc-4da6-9fcc-e1edbfa8fbe5 service nova] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:30.787815 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [req-d7202305-0e7a-45ee-b27e-df1251647457 req-0e957019-3ccc-4da6-9fcc-e1edbfa8fbe5 service nova] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:30.823020 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.compute.server_external_events [req-d7202305-0e7a-45ee-b27e-df1251647457 req-0e957019-3ccc-4da6-9fcc-e1edbfa8fbe5 service nova] Creating event network-vif-deleted:eb607d9e-2e93-47a0-8ad5-4d68c6faaa44 for instance fb8d3af9-4513-4f65-8863-0f910fd46f04 on hv-cinder-81644 Dec 24 10:48:30.832211 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [req-d7202305-0e7a-45ee-b27e-df1251647457 req-0e957019-3ccc-4da6-9fcc-e1edbfa8fbe5 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067988 Dec 24 10:48:30.833512 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 330/651] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Dec 24 10:48:30 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 10:48:31.001905 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-a09d1a8c-c46f-4d24-9297-83de10b9e695 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:48:31.002934 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-a09d1a8c-c46f-4d24-9297-83de10b9e695 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] [instance: c2c661f2-d3da-4357-a7a8-3f85fc94cc60] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:48:31.009209 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-a09d1a8c-c46f-4d24-9297-83de10b9e695 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:31.009661 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-a09d1a8c-c46f-4d24-9297-83de10b9e695 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:31.010444 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-a09d1a8c-c46f-4d24-9297-83de10b9e695 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:31.011126 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-a09d1a8c-c46f-4d24-9297-83de10b9e695 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:31.036520 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-e8c80d83-6a4e-4af6-9c67-9cde07945e8d tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:48:31.038194 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-e8c80d83-6a4e-4af6-9c67-9cde07945e8d tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] [instance: 9330dbb8-edad-4d54-afeb-8badc464250d] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:48:31.048750 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-e8c80d83-6a4e-4af6-9c67-9cde07945e8d tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:31.056020 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-e8c80d83-6a4e-4af6-9c67-9cde07945e8d tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:31.056020 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-e8c80d83-6a4e-4af6-9c67-9cde07945e8d tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:31.056020 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-e8c80d83-6a4e-4af6-9c67-9cde07945e8d tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:31.174839 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-a09d1a8c-c46f-4d24-9297-83de10b9e695 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d627b760f74f48ac560e2ce2e74e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '378bb44ad89440e49f7e290a5d31004e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:48:31.182614 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-a09d1a8c-c46f-4d24-9297-83de10b9e695 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] 10.222.0.30 "GET /compute/v2.1/servers/c2c661f2-d3da-4357-a7a8-3f85fc94cc60" status: 200 len: 1508 microversion: 2.1 time: 0.185372 Dec 24 10:48:31.183503 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 322/652] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:48:30 2021] GET /compute/v2.1/servers/c2c661f2-d3da-4357-a7a8-3f85fc94cc60 => generated 1508 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:48:31.199496 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-bb64ff19-cb1f-484e-9541-0dd61a1a4f13 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:48:31.199496 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-bb64ff19-cb1f-484e-9541-0dd61a1a4f13 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] [instance: 91615e87-1e43-4d69-baab-d7af897d1ac3] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:48:31.202577 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-bb64ff19-cb1f-484e-9541-0dd61a1a4f13 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:31.203100 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-bb64ff19-cb1f-484e-9541-0dd61a1a4f13 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:31.204609 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-bb64ff19-cb1f-484e-9541-0dd61a1a4f13 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:31.205151 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-bb64ff19-cb1f-484e-9541-0dd61a1a4f13 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:31.275956 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-e8c80d83-6a4e-4af6-9c67-9cde07945e8d tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37516225f9244c969ed168f6a024482a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0115a5cc8b4b1e8bffb84e0f3e0b08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:48:31.286223 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-e8c80d83-6a4e-4af6-9c67-9cde07945e8d tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] 10.222.0.30 "GET /compute/v2.1/servers/9330dbb8-edad-4d54-afeb-8badc464250d" status: 200 len: 1701 microversion: 2.1 time: 0.254396 Dec 24 10:48:31.287302 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 331/653] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:48:31 2021] GET /compute/v2.1/servers/9330dbb8-edad-4d54-afeb-8badc464250d => generated 1701 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:48:31.302732 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-66657d1c-c0b7-4d09-a466-b41eb23f3195 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:48:31.314062 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-66657d1c-c0b7-4d09-a466-b41eb23f3195 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:31.317255 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-66657d1c-c0b7-4d09-a466-b41eb23f3195 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:31.323972 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-bb64ff19-cb1f-484e-9541-0dd61a1a4f13 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b690a952a1704197baf5e653e27160f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0fd34670674906aa9a61200251b76c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:48:31.332135 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-bb64ff19-cb1f-484e-9541-0dd61a1a4f13 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] 10.222.0.30 "GET /compute/v2.1/servers/91615e87-1e43-4d69-baab-d7af897d1ac3" status: 200 len: 1209 microversion: 2.1 time: 0.147376 Dec 24 10:48:31.333864 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 323/654] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:48:31 2021] GET /compute/v2.1/servers/91615e87-1e43-4d69-baab-d7af897d1ac3 => generated 1209 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:48:31.392105 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-66657d1c-c0b7-4d09-a466-b41eb23f3195 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] [instance: 9330dbb8-edad-4d54-afeb-8badc464250d] Going to try to start instance {{(pid=123432) start /opt/stack/nova/nova/compute/api.py:2677}} Dec 24 10:48:31.454651 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-8e3ae9f2-d246-4f39-91c0-cda357a32699 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:48:31.455369 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-8e3ae9f2-d246-4f39-91c0-cda357a32699 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] [instance: fb8d3af9-4513-4f65-8863-0f910fd46f04] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:48:31.461219 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-8e3ae9f2-d246-4f39-91c0-cda357a32699 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:31.461712 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-8e3ae9f2-d246-4f39-91c0-cda357a32699 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:31.462465 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-8e3ae9f2-d246-4f39-91c0-cda357a32699 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:31.462892 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-8e3ae9f2-d246-4f39-91c0-cda357a32699 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:31.493765 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-8e3ae9f2-d246-4f39-91c0-cda357a32699 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:31.494209 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-8e3ae9f2-d246-4f39-91c0-cda357a32699 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:31.494669 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.objects.instance [None req-8e3ae9f2-d246-4f39-91c0-cda357a32699 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lazy-loading 'fault' on Instance uuid fb8d3af9-4513-4f65-8863-0f910fd46f04 {{(pid=123431) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 24 10:48:31.544113 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-8e3ae9f2-d246-4f39-91c0-cda357a32699 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ad5096717dc425c849dfe95ea55a6af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62d11172cdf4959a15ac1ffc5601aca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:48:31.568359 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-8e3ae9f2-d246-4f39-91c0-cda357a32699 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] 10.222.0.30 "GET /compute/v2.1/servers/fb8d3af9-4513-4f65-8863-0f910fd46f04" status: 200 len: 1308 microversion: 2.1 time: 0.100963 Dec 24 10:48:31.568359 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 324/655] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:48:31 2021] GET /compute/v2.1/servers/fb8d3af9-4513-4f65-8863-0f910fd46f04 => generated 1308 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 24 10:48:31.781931 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-d1e86368-4582-4a37-aafa-f1f27cddbca3 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:48:31.782452 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-d1e86368-4582-4a37-aafa-f1f27cddbca3 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] [instance: a99a6a98-4010-4f8e-a83f-fcc490f6ece0] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:48:31.789236 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-d1e86368-4582-4a37-aafa-f1f27cddbca3 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:31.789690 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-d1e86368-4582-4a37-aafa-f1f27cddbca3 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:31.790459 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-d1e86368-4582-4a37-aafa-f1f27cddbca3 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:31.790880 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-d1e86368-4582-4a37-aafa-f1f27cddbca3 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:31.933360 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-66657d1c-c0b7-4d09-a466-b41eb23f3195 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] 10.222.0.30 "POST /compute/v2.1/servers/9330dbb8-edad-4d54-afeb-8badc464250d/action" status: 202 len: 0 microversion: 2.1 time: 0.634243 Dec 24 10:48:31.934321 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 332/656] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Dec 24 10:48:31 2021] POST /compute/v2.1/servers/9330dbb8-edad-4d54-afeb-8badc464250d/action => generated 0 bytes in 636 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 24 10:48:31.944390 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-82fee297-80fb-4ed1-95f8-d9cfbd75f2ba tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:48:31.945312 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-82fee297-80fb-4ed1-95f8-d9cfbd75f2ba tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] [instance: 9330dbb8-edad-4d54-afeb-8badc464250d] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:48:31.951918 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-82fee297-80fb-4ed1-95f8-d9cfbd75f2ba tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:31.952464 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-82fee297-80fb-4ed1-95f8-d9cfbd75f2ba tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:31.953359 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-82fee297-80fb-4ed1-95f8-d9cfbd75f2ba tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:31.953791 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-82fee297-80fb-4ed1-95f8-d9cfbd75f2ba tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:31.983340 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-d1e86368-4582-4a37-aafa-f1f27cddbca3 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:48:31.997398 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-d1e86368-4582-4a37-aafa-f1f27cddbca3 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:48:32.001913 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-d1e86368-4582-4a37-aafa-f1f27cddbca3 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:48:32.001913 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-d1e86368-4582-4a37-aafa-f1f27cddbca3 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] 10.222.0.30 "GET /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0" status: 200 len: 1808 microversion: 2.20 time: 0.222362 Dec 24 10:48:32.004186 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 325/657] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Dec 24 10:48:31 2021] GET /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0 => generated 1808 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 24 10:48:32.131625 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-82fee297-80fb-4ed1-95f8-d9cfbd75f2ba tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37516225f9244c969ed168f6a024482a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0115a5cc8b4b1e8bffb84e0f3e0b08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:48:32.141163 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-82fee297-80fb-4ed1-95f8-d9cfbd75f2ba tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] 10.222.0.30 "GET /compute/v2.1/servers/9330dbb8-edad-4d54-afeb-8badc464250d" status: 200 len: 1710 microversion: 2.1 time: 0.201549 Dec 24 10:48:32.142993 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 333/658] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:48:31 2021] GET /compute/v2.1/servers/9330dbb8-edad-4d54-afeb-8badc464250d => generated 1710 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:48:32.199597 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-ecd8cfae-89f3-499a-aa6a-a0d3932efcc7 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:48:32.205247 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-ecd8cfae-89f3-499a-aa6a-a0d3932efcc7 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] [instance: c2c661f2-d3da-4357-a7a8-3f85fc94cc60] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:48:32.208070 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-ecd8cfae-89f3-499a-aa6a-a0d3932efcc7 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:32.213489 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-ecd8cfae-89f3-499a-aa6a-a0d3932efcc7 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:32.214446 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-ecd8cfae-89f3-499a-aa6a-a0d3932efcc7 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:32.215202 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-ecd8cfae-89f3-499a-aa6a-a0d3932efcc7 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:32.349945 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-ff0152c6-94b4-416f-9231-b49426695081 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:48:32.350562 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-ff0152c6-94b4-416f-9231-b49426695081 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] [instance: 91615e87-1e43-4d69-baab-d7af897d1ac3] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:48:32.368385 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-ff0152c6-94b4-416f-9231-b49426695081 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:32.368866 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-ff0152c6-94b4-416f-9231-b49426695081 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:32.369678 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-ff0152c6-94b4-416f-9231-b49426695081 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:32.370112 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-ff0152c6-94b4-416f-9231-b49426695081 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:32.535669 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-ecd8cfae-89f3-499a-aa6a-a0d3932efcc7 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d627b760f74f48ac560e2ce2e74e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '378bb44ad89440e49f7e290a5d31004e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:48:32.544304 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-ecd8cfae-89f3-499a-aa6a-a0d3932efcc7 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] 10.222.0.30 "GET /compute/v2.1/servers/c2c661f2-d3da-4357-a7a8-3f85fc94cc60" status: 200 len: 1508 microversion: 2.1 time: 0.348351 Dec 24 10:48:32.545821 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 326/659] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:48:32 2021] GET /compute/v2.1/servers/c2c661f2-d3da-4357-a7a8-3f85fc94cc60 => generated 1508 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:48:32.568515 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-b709cfa5-21d9-4e3d-9287-b426630c3bfe tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:48:32.569317 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-b709cfa5-21d9-4e3d-9287-b426630c3bfe tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] [instance: fb8d3af9-4513-4f65-8863-0f910fd46f04] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:48:32.575949 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-b709cfa5-21d9-4e3d-9287-b426630c3bfe tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:32.576329 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-b709cfa5-21d9-4e3d-9287-b426630c3bfe tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:32.577359 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-b709cfa5-21d9-4e3d-9287-b426630c3bfe tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:32.577863 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-b709cfa5-21d9-4e3d-9287-b426630c3bfe tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:32.592283 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.wsgi [None req-b709cfa5-21d9-4e3d-9287-b426630c3bfe tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] HTTP exception thrown: Instance fb8d3af9-4513-4f65-8863-0f910fd46f04 could not be found. Dec 24 10:48:32.592986 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-b709cfa5-21d9-4e3d-9287-b426630c3bfe tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Returning 404 to user: Instance fb8d3af9-4513-4f65-8863-0f910fd46f04 could not be found. {{(pid=123431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 24 10:48:32.593731 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-b709cfa5-21d9-4e3d-9287-b426630c3bfe tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] 10.222.0.30 "GET /compute/v2.1/servers/fb8d3af9-4513-4f65-8863-0f910fd46f04" status: 404 len: 111 microversion: 2.1 time: 0.029996 Dec 24 10:48:32.594285 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 327/660] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:48:32 2021] GET /compute/v2.1/servers/fb8d3af9-4513-4f65-8863-0f910fd46f04 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Dec 24 10:48:32.602492 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-d2f72ed2-b7bf-4792-9cd8-65e3311df5e1 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:48:32.603074 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-d2f72ed2-b7bf-4792-9cd8-65e3311df5e1 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] [instance: 6427d66b-d1b3-4cc1-ba3e-f8a8c479189c] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:48:32.610190 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-d2f72ed2-b7bf-4792-9cd8-65e3311df5e1 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:32.610190 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-d2f72ed2-b7bf-4792-9cd8-65e3311df5e1 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:32.611420 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-d2f72ed2-b7bf-4792-9cd8-65e3311df5e1 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:32.611862 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-d2f72ed2-b7bf-4792-9cd8-65e3311df5e1 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:32.641906 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-d2f72ed2-b7bf-4792-9cd8-65e3311df5e1 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] [instance: 6427d66b-d1b3-4cc1-ba3e-f8a8c479189c] Going to try to terminate instance {{(pid=123431) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 24 10:48:32.690019 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-ff0152c6-94b4-416f-9231-b49426695081 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b690a952a1704197baf5e653e27160f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0fd34670674906aa9a61200251b76c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:48:32.697754 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-ff0152c6-94b4-416f-9231-b49426695081 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] 10.222.0.30 "GET /compute/v2.1/servers/91615e87-1e43-4d69-baab-d7af897d1ac3" status: 200 len: 1277 microversion: 2.1 time: 0.351388 Dec 24 10:48:32.698330 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 334/661] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:48:32 2021] GET /compute/v2.1/servers/91615e87-1e43-4d69-baab-d7af897d1ac3 => generated 1277 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 24 10:48:33.024249 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-983ad9b4-e665-4497-a9ef-3432e65ddf23 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:48:33.025114 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-983ad9b4-e665-4497-a9ef-3432e65ddf23 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] [instance: a99a6a98-4010-4f8e-a83f-fcc490f6ece0] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:48:33.032715 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-983ad9b4-e665-4497-a9ef-3432e65ddf23 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:33.033442 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-983ad9b4-e665-4497-a9ef-3432e65ddf23 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:33.034455 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-983ad9b4-e665-4497-a9ef-3432e65ddf23 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:33.035076 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-983ad9b4-e665-4497-a9ef-3432e65ddf23 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:33.165138 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-d2f72ed2-b7bf-4792-9cd8-65e3311df5e1 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] 10.222.0.30 "DELETE /compute/v2.1/servers/6427d66b-d1b3-4cc1-ba3e-f8a8c479189c" status: 204 len: 0 microversion: 2.1 time: 0.565789 Dec 24 10:48:33.168396 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 328/662] 10.222.0.30 () {58 vars in 1238 bytes} [Fri Dec 24 10:48:32 2021] DELETE /compute/v2.1/servers/6427d66b-d1b3-4cc1-ba3e-f8a8c479189c => generated 0 bytes in 567 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Dec 24 10:48:33.173381 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-43c14b37-d5cd-448a-86b1-3163d82f3a9d tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:48:33.173381 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-43c14b37-d5cd-448a-86b1-3163d82f3a9d tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] [instance: 9330dbb8-edad-4d54-afeb-8badc464250d] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:48:33.178332 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-43c14b37-d5cd-448a-86b1-3163d82f3a9d tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:33.178790 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-43c14b37-d5cd-448a-86b1-3163d82f3a9d tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:33.179757 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-43c14b37-d5cd-448a-86b1-3163d82f3a9d tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:33.180186 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-43c14b37-d5cd-448a-86b1-3163d82f3a9d tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:33.195326 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-983ad9b4-e665-4497-a9ef-3432e65ddf23 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:48:33.218216 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-983ad9b4-e665-4497-a9ef-3432e65ddf23 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:48:33.218216 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-983ad9b4-e665-4497-a9ef-3432e65ddf23 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:48:33.218216 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-983ad9b4-e665-4497-a9ef-3432e65ddf23 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] 10.222.0.30 "GET /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0" status: 200 len: 1808 microversion: 2.20 time: 0.196910 Dec 24 10:48:33.224556 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 335/663] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Dec 24 10:48:33 2021] GET /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0 => generated 1808 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 10:48:33.232746 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-bbccf83a-70fb-4318-9cef-ce8792f67687 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:48:33.234924 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-bbccf83a-70fb-4318-9cef-ce8792f67687 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] [instance: 6427d66b-d1b3-4cc1-ba3e-f8a8c479189c] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:48:33.250625 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-bbccf83a-70fb-4318-9cef-ce8792f67687 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:33.251674 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-bbccf83a-70fb-4318-9cef-ce8792f67687 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:33.252733 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-bbccf83a-70fb-4318-9cef-ce8792f67687 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:33.254577 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-bbccf83a-70fb-4318-9cef-ce8792f67687 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:33.401931 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-43c14b37-d5cd-448a-86b1-3163d82f3a9d tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37516225f9244c969ed168f6a024482a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0115a5cc8b4b1e8bffb84e0f3e0b08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:48:33.410300 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-43c14b37-d5cd-448a-86b1-3163d82f3a9d tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] 10.222.0.30 "GET /compute/v2.1/servers/9330dbb8-edad-4d54-afeb-8badc464250d" status: 200 len: 1710 microversion: 2.1 time: 0.243312 Dec 24 10:48:33.413064 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 329/664] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:48:33 2021] GET /compute/v2.1/servers/9330dbb8-edad-4d54-afeb-8badc464250d => generated 1710 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:48:33.418103 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [req-676899bd-fb13-4735-8745-2aaf2b71ea8c req-d1d2e92c-7c31-40bf-b58d-03bc9f631881 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "91615e87-1e43-4d69-baab-d7af897d1ac3", "tag": "85e920ef-bc3e-40d9-a188-7900892566bf"}]} {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:48:33.420273 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 10:48:33.420273 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: warnings.warn(msg) Dec 24 10:48:33.428423 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [req-676899bd-fb13-4735-8745-2aaf2b71ea8c req-d1d2e92c-7c31-40bf-b58d-03bc9f631881 service nova] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:33.429210 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [req-676899bd-fb13-4735-8745-2aaf2b71ea8c req-d1d2e92c-7c31-40bf-b58d-03bc9f631881 service nova] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:33.448624 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.compute.server_external_events [req-676899bd-fb13-4735-8745-2aaf2b71ea8c req-d1d2e92c-7c31-40bf-b58d-03bc9f631881 service nova] Creating event network-changed:85e920ef-bc3e-40d9-a188-7900892566bf for instance 91615e87-1e43-4d69-baab-d7af897d1ac3 on hv-cinder-81644 Dec 24 10:48:33.460936 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [req-676899bd-fb13-4735-8745-2aaf2b71ea8c req-d1d2e92c-7c31-40bf-b58d-03bc9f631881 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043092 Dec 24 10:48:33.462292 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 330/665] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Dec 24 10:48:33 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 10:48:33.562441 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-2c42c026-2853-4ea2-bb11-1f798b55c10c tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:48:33.562987 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-2c42c026-2853-4ea2-bb11-1f798b55c10c tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] [instance: c2c661f2-d3da-4357-a7a8-3f85fc94cc60] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:48:33.570130 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-2c42c026-2853-4ea2-bb11-1f798b55c10c tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:33.570586 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-2c42c026-2853-4ea2-bb11-1f798b55c10c tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:33.571370 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-2c42c026-2853-4ea2-bb11-1f798b55c10c tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:33.571925 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-2c42c026-2853-4ea2-bb11-1f798b55c10c tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:33.651166 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-2c42c026-2853-4ea2-bb11-1f798b55c10c tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d627b760f74f48ac560e2ce2e74e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '378bb44ad89440e49f7e290a5d31004e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:48:33.659086 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-2c42c026-2853-4ea2-bb11-1f798b55c10c tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] 10.222.0.30 "GET /compute/v2.1/servers/c2c661f2-d3da-4357-a7a8-3f85fc94cc60" status: 200 len: 1466 microversion: 2.1 time: 0.101033 Dec 24 10:48:33.659670 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 331/666] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:48:33 2021] GET /compute/v2.1/servers/c2c661f2-d3da-4357-a7a8-3f85fc94cc60 => generated 1466 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:48:33.663992 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [req-79baf3a6-e409-48f6-9ccc-2ee05d5e1a1c req-c72f8ef7-2b7b-4783-95af-0ef9340e55d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c2c661f2-d3da-4357-a7a8-3f85fc94cc60", "name": "network-vif-deleted", "tag": "11e42488-46c0-47e4-b7d6-51ddfdde57c9"}]} {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:48:33.665484 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 10:48:33.665484 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: warnings.warn(msg) Dec 24 10:48:33.672163 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [req-79baf3a6-e409-48f6-9ccc-2ee05d5e1a1c req-c72f8ef7-2b7b-4783-95af-0ef9340e55d3 service nova] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:33.673179 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [req-79baf3a6-e409-48f6-9ccc-2ee05d5e1a1c req-c72f8ef7-2b7b-4783-95af-0ef9340e55d3 service nova] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:33.686370 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-bbccf83a-70fb-4318-9cef-ce8792f67687 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ad5096717dc425c849dfe95ea55a6af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62d11172cdf4959a15ac1ffc5601aca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:48:33.693791 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.compute.server_external_events [req-79baf3a6-e409-48f6-9ccc-2ee05d5e1a1c req-c72f8ef7-2b7b-4783-95af-0ef9340e55d3 service nova] Creating event network-vif-deleted:11e42488-46c0-47e4-b7d6-51ddfdde57c9 for instance c2c661f2-d3da-4357-a7a8-3f85fc94cc60 on hv-cinder-81644 Dec 24 10:48:33.696212 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-bbccf83a-70fb-4318-9cef-ce8792f67687 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] 10.222.0.30 "GET /compute/v2.1/servers/6427d66b-d1b3-4cc1-ba3e-f8a8c479189c" status: 200 len: 1514 microversion: 2.1 time: 0.470465 Dec 24 10:48:33.696791 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 336/667] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:48:33 2021] GET /compute/v2.1/servers/6427d66b-d1b3-4cc1-ba3e-f8a8c479189c => generated 1514 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:48:33.701855 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [req-79baf3a6-e409-48f6-9ccc-2ee05d5e1a1c req-c72f8ef7-2b7b-4783-95af-0ef9340e55d3 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041006 Dec 24 10:48:33.710254 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 332/668] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Dec 24 10:48:33 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 10:48:33.716180 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-802eb7ba-6f65-4c8c-a5ee-875492da5043 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:48:33.716792 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-802eb7ba-6f65-4c8c-a5ee-875492da5043 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] [instance: 91615e87-1e43-4d69-baab-d7af897d1ac3] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:48:33.722974 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-802eb7ba-6f65-4c8c-a5ee-875492da5043 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:33.723441 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-802eb7ba-6f65-4c8c-a5ee-875492da5043 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:33.724246 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-802eb7ba-6f65-4c8c-a5ee-875492da5043 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:33.724751 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-802eb7ba-6f65-4c8c-a5ee-875492da5043 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:33.862559 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-802eb7ba-6f65-4c8c-a5ee-875492da5043 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b690a952a1704197baf5e653e27160f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0fd34670674906aa9a61200251b76c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:48:33.870379 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-802eb7ba-6f65-4c8c-a5ee-875492da5043 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] 10.222.0.30 "GET /compute/v2.1/servers/91615e87-1e43-4d69-baab-d7af897d1ac3" status: 200 len: 1265 microversion: 2.1 time: 0.159991 Dec 24 10:48:33.880951 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 337/669] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:48:33 2021] GET /compute/v2.1/servers/91615e87-1e43-4d69-baab-d7af897d1ac3 => generated 1265 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:48:34.243094 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-5c03d942-0097-4266-bb85-20b768c78829 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:48:34.243777 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-5c03d942-0097-4266-bb85-20b768c78829 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] [instance: a99a6a98-4010-4f8e-a83f-fcc490f6ece0] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:48:34.249881 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-5c03d942-0097-4266-bb85-20b768c78829 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:34.250332 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-5c03d942-0097-4266-bb85-20b768c78829 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:34.251099 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-5c03d942-0097-4266-bb85-20b768c78829 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:34.251528 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-5c03d942-0097-4266-bb85-20b768c78829 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:34.427356 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-ed4c6d44-6503-4990-b81b-8ce9ab6ddb77 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:48:34.427956 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-ed4c6d44-6503-4990-b81b-8ce9ab6ddb77 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] [instance: 9330dbb8-edad-4d54-afeb-8badc464250d] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:48:34.434409 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-ed4c6d44-6503-4990-b81b-8ce9ab6ddb77 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:34.434858 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-ed4c6d44-6503-4990-b81b-8ce9ab6ddb77 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:34.435664 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-ed4c6d44-6503-4990-b81b-8ce9ab6ddb77 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:34.436111 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-ed4c6d44-6503-4990-b81b-8ce9ab6ddb77 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:34.476514 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-5c03d942-0097-4266-bb85-20b768c78829 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:48:34.484997 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-5c03d942-0097-4266-bb85-20b768c78829 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:48:34.486496 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-5c03d942-0097-4266-bb85-20b768c78829 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:48:34.487689 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-5c03d942-0097-4266-bb85-20b768c78829 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] 10.222.0.30 "GET /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0" status: 200 len: 1808 microversion: 2.20 time: 0.249254 Dec 24 10:48:34.492919 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 333/670] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Dec 24 10:48:34 2021] GET /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0 => generated 1808 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 10:48:34.568784 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-ed4c6d44-6503-4990-b81b-8ce9ab6ddb77 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37516225f9244c969ed168f6a024482a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0115a5cc8b4b1e8bffb84e0f3e0b08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:48:34.576750 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-ed4c6d44-6503-4990-b81b-8ce9ab6ddb77 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] 10.222.0.30 "GET /compute/v2.1/servers/9330dbb8-edad-4d54-afeb-8badc464250d" status: 200 len: 1714 microversion: 2.1 time: 0.153173 Dec 24 10:48:34.577344 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 338/671] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:48:34 2021] GET /compute/v2.1/servers/9330dbb8-edad-4d54-afeb-8badc464250d => generated 1714 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 24 10:48:34.675018 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-860c17d1-e623-4b28-9d11-703d69806fb8 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:48:34.675921 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-860c17d1-e623-4b28-9d11-703d69806fb8 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] [instance: c2c661f2-d3da-4357-a7a8-3f85fc94cc60] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:48:34.681706 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-860c17d1-e623-4b28-9d11-703d69806fb8 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:34.682083 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-860c17d1-e623-4b28-9d11-703d69806fb8 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:34.682838 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-860c17d1-e623-4b28-9d11-703d69806fb8 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:34.683263 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-860c17d1-e623-4b28-9d11-703d69806fb8 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:34.713158 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-860c17d1-e623-4b28-9d11-703d69806fb8 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:34.713614 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-860c17d1-e623-4b28-9d11-703d69806fb8 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:34.714059 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.objects.instance [None req-860c17d1-e623-4b28-9d11-703d69806fb8 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lazy-loading 'fault' on Instance uuid c2c661f2-d3da-4357-a7a8-3f85fc94cc60 {{(pid=123431) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 24 10:48:34.723627 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-61df22f5-768e-4426-8da3-1548db6f92d9 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:48:34.724457 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-61df22f5-768e-4426-8da3-1548db6f92d9 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] [instance: 6427d66b-d1b3-4cc1-ba3e-f8a8c479189c] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:48:34.730474 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-61df22f5-768e-4426-8da3-1548db6f92d9 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:34.730919 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-61df22f5-768e-4426-8da3-1548db6f92d9 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:34.731695 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-61df22f5-768e-4426-8da3-1548db6f92d9 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:34.732123 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-61df22f5-768e-4426-8da3-1548db6f92d9 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:34.752428 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-860c17d1-e623-4b28-9d11-703d69806fb8 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d627b760f74f48ac560e2ce2e74e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '378bb44ad89440e49f7e290a5d31004e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:48:34.759664 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-860c17d1-e623-4b28-9d11-703d69806fb8 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] 10.222.0.30 "GET /compute/v2.1/servers/c2c661f2-d3da-4357-a7a8-3f85fc94cc60" status: 200 len: 1312 microversion: 2.1 time: 0.088215 Dec 24 10:48:34.760246 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 334/672] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:48:34 2021] GET /compute/v2.1/servers/c2c661f2-d3da-4357-a7a8-3f85fc94cc60 => generated 1312 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:48:34.863411 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-61df22f5-768e-4426-8da3-1548db6f92d9 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ad5096717dc425c849dfe95ea55a6af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62d11172cdf4959a15ac1ffc5601aca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:48:34.870641 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-61df22f5-768e-4426-8da3-1548db6f92d9 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] 10.222.0.30 "GET /compute/v2.1/servers/6427d66b-d1b3-4cc1-ba3e-f8a8c479189c" status: 200 len: 1514 microversion: 2.1 time: 0.150624 Dec 24 10:48:34.871204 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 339/673] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:48:34 2021] GET /compute/v2.1/servers/6427d66b-d1b3-4cc1-ba3e-f8a8c479189c => generated 1514 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 24 10:48:34.887026 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-2770e6c9-95e6-41d9-bd1b-38f4bf743eb3 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:48:34.887626 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-2770e6c9-95e6-41d9-bd1b-38f4bf743eb3 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] [instance: 91615e87-1e43-4d69-baab-d7af897d1ac3] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:48:34.894043 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-2770e6c9-95e6-41d9-bd1b-38f4bf743eb3 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:34.894502 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-2770e6c9-95e6-41d9-bd1b-38f4bf743eb3 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:34.895268 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-2770e6c9-95e6-41d9-bd1b-38f4bf743eb3 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:34.895696 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-2770e6c9-95e6-41d9-bd1b-38f4bf743eb3 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:35.042957 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-2770e6c9-95e6-41d9-bd1b-38f4bf743eb3 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b690a952a1704197baf5e653e27160f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0fd34670674906aa9a61200251b76c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:48:35.052090 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-2770e6c9-95e6-41d9-bd1b-38f4bf743eb3 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] 10.222.0.30 "GET /compute/v2.1/servers/91615e87-1e43-4d69-baab-d7af897d1ac3" status: 200 len: 1265 microversion: 2.1 time: 0.168520 Dec 24 10:48:35.053115 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 335/674] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:48:34 2021] GET /compute/v2.1/servers/91615e87-1e43-4d69-baab-d7af897d1ac3 => generated 1265 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:48:35.505283 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-f7dace30-c099-4cd4-a5b6-7c73edd33d5b tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:48:35.505803 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-f7dace30-c099-4cd4-a5b6-7c73edd33d5b tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] [instance: a99a6a98-4010-4f8e-a83f-fcc490f6ece0] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:48:35.512103 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-f7dace30-c099-4cd4-a5b6-7c73edd33d5b tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:35.512584 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-f7dace30-c099-4cd4-a5b6-7c73edd33d5b tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:35.513409 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-f7dace30-c099-4cd4-a5b6-7c73edd33d5b tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:35.513843 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-f7dace30-c099-4cd4-a5b6-7c73edd33d5b tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:35.656051 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-f7dace30-c099-4cd4-a5b6-7c73edd33d5b tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:48:35.656663 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [req-335f77cc-78bc-458f-8ec4-ff6cde638ad3 req-e55ffa06-ba17-411b-84a3-1602d0959c2c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6427d66b-d1b3-4cc1-ba3e-f8a8c479189c", "name": "network-vif-deleted", "tag": "d90cd231-c375-419c-945c-fe78bf0f2cf4"}]} {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:48:35.661433 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 10:48:35.661433 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: warnings.warn(msg) Dec 24 10:48:35.665878 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [req-335f77cc-78bc-458f-8ec4-ff6cde638ad3 req-e55ffa06-ba17-411b-84a3-1602d0959c2c service nova] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:35.666019 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-f7dace30-c099-4cd4-a5b6-7c73edd33d5b tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:48:35.666319 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [req-335f77cc-78bc-458f-8ec4-ff6cde638ad3 req-e55ffa06-ba17-411b-84a3-1602d0959c2c service nova] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:35.667901 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-f7dace30-c099-4cd4-a5b6-7c73edd33d5b tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:48:35.669099 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-f7dace30-c099-4cd4-a5b6-7c73edd33d5b tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] 10.222.0.30 "GET /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0" status: 200 len: 1808 microversion: 2.20 time: 0.167536 Dec 24 10:48:35.669822 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 340/675] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Dec 24 10:48:35 2021] GET /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0 => generated 1808 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 10:48:35.682810 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.compute.server_external_events [req-335f77cc-78bc-458f-8ec4-ff6cde638ad3 req-e55ffa06-ba17-411b-84a3-1602d0959c2c service nova] Creating event network-vif-deleted:d90cd231-c375-419c-945c-fe78bf0f2cf4 for instance 6427d66b-d1b3-4cc1-ba3e-f8a8c479189c on hv-cinder-81644 Dec 24 10:48:35.689905 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [req-335f77cc-78bc-458f-8ec4-ff6cde638ad3 req-e55ffa06-ba17-411b-84a3-1602d0959c2c service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034450 Dec 24 10:48:35.689905 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 336/676] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Dec 24 10:48:35 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 24 10:48:35.777831 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-cc987f12-b457-4a87-94bf-0a38315ddf77 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:48:35.778359 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-cc987f12-b457-4a87-94bf-0a38315ddf77 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] [instance: c2c661f2-d3da-4357-a7a8-3f85fc94cc60] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:48:35.785800 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-cc987f12-b457-4a87-94bf-0a38315ddf77 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:35.786395 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-cc987f12-b457-4a87-94bf-0a38315ddf77 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:35.787177 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-cc987f12-b457-4a87-94bf-0a38315ddf77 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:35.787609 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-cc987f12-b457-4a87-94bf-0a38315ddf77 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:35.801077 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.wsgi [None req-cc987f12-b457-4a87-94bf-0a38315ddf77 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] HTTP exception thrown: Instance c2c661f2-d3da-4357-a7a8-3f85fc94cc60 could not be found. Dec 24 10:48:35.801668 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-cc987f12-b457-4a87-94bf-0a38315ddf77 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Returning 404 to user: Instance c2c661f2-d3da-4357-a7a8-3f85fc94cc60 could not be found. {{(pid=123432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 24 10:48:35.808919 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-cc987f12-b457-4a87-94bf-0a38315ddf77 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] 10.222.0.30 "GET /compute/v2.1/servers/c2c661f2-d3da-4357-a7a8-3f85fc94cc60" status: 404 len: 111 microversion: 2.1 time: 0.029061 Dec 24 10:48:35.808919 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 341/677] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:48:35 2021] GET /compute/v2.1/servers/c2c661f2-d3da-4357-a7a8-3f85fc94cc60 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 24 10:48:35.811207 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-fc33c4ef-57f0-4634-b780-fcd6d53ff6d1 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:48:35.811817 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-fc33c4ef-57f0-4634-b780-fcd6d53ff6d1 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] [instance: 54d2f913-8385-4f34-8cb0-8c0f08c7a30f] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:48:35.817843 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-fc33c4ef-57f0-4634-b780-fcd6d53ff6d1 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:35.818523 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-fc33c4ef-57f0-4634-b780-fcd6d53ff6d1 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:35.819476 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-fc33c4ef-57f0-4634-b780-fcd6d53ff6d1 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:35.819908 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-fc33c4ef-57f0-4634-b780-fcd6d53ff6d1 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:35.844394 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-fc33c4ef-57f0-4634-b780-fcd6d53ff6d1 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] [instance: 54d2f913-8385-4f34-8cb0-8c0f08c7a30f] Going to try to terminate instance {{(pid=123431) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 24 10:48:35.887102 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-6d78f775-46d0-4a10-a3bc-862b1fc83dcb tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:48:35.887711 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-6d78f775-46d0-4a10-a3bc-862b1fc83dcb tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] [instance: 6427d66b-d1b3-4cc1-ba3e-f8a8c479189c] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:48:35.894102 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-6d78f775-46d0-4a10-a3bc-862b1fc83dcb tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:35.894545 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-6d78f775-46d0-4a10-a3bc-862b1fc83dcb tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:35.895315 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-6d78f775-46d0-4a10-a3bc-862b1fc83dcb tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:35.895741 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-6d78f775-46d0-4a10-a3bc-862b1fc83dcb tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:35.925971 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-6d78f775-46d0-4a10-a3bc-862b1fc83dcb tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:35.926406 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-6d78f775-46d0-4a10-a3bc-862b1fc83dcb tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:35.926847 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.objects.instance [None req-6d78f775-46d0-4a10-a3bc-862b1fc83dcb tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lazy-loading 'fault' on Instance uuid 6427d66b-d1b3-4cc1-ba3e-f8a8c479189c {{(pid=123432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 24 10:48:35.967224 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-6d78f775-46d0-4a10-a3bc-862b1fc83dcb tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ad5096717dc425c849dfe95ea55a6af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62d11172cdf4959a15ac1ffc5601aca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:48:35.974907 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-6d78f775-46d0-4a10-a3bc-862b1fc83dcb tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] 10.222.0.30 "GET /compute/v2.1/servers/6427d66b-d1b3-4cc1-ba3e-f8a8c479189c" status: 200 len: 1308 microversion: 2.1 time: 0.091394 Dec 24 10:48:35.975461 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 342/678] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:48:35 2021] GET /compute/v2.1/servers/6427d66b-d1b3-4cc1-ba3e-f8a8c479189c => generated 1308 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 24 10:48:36.069144 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-dd911261-5486-4440-8664-d1a64c58d767 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:48:36.069667 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-dd911261-5486-4440-8664-d1a64c58d767 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] [instance: 91615e87-1e43-4d69-baab-d7af897d1ac3] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:48:36.075411 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-dd911261-5486-4440-8664-d1a64c58d767 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:36.075851 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-dd911261-5486-4440-8664-d1a64c58d767 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:36.076616 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-dd911261-5486-4440-8664-d1a64c58d767 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:36.077073 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-dd911261-5486-4440-8664-d1a64c58d767 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:36.181202 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-fc33c4ef-57f0-4634-b780-fcd6d53ff6d1 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] 10.222.0.30 "DELETE /compute/v2.1/servers/54d2f913-8385-4f34-8cb0-8c0f08c7a30f" status: 204 len: 0 microversion: 2.1 time: 0.373599 Dec 24 10:48:36.181978 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 337/679] 10.222.0.30 () {58 vars in 1238 bytes} [Fri Dec 24 10:48:35 2021] DELETE /compute/v2.1/servers/54d2f913-8385-4f34-8cb0-8c0f08c7a30f => generated 0 bytes in 375 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 24 10:48:36.190511 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-d8c4f101-bbd2-410f-8d39-04e27a2334bf tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:48:36.191321 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-d8c4f101-bbd2-410f-8d39-04e27a2334bf tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] [instance: 54d2f913-8385-4f34-8cb0-8c0f08c7a30f] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:48:36.197144 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-d8c4f101-bbd2-410f-8d39-04e27a2334bf tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:36.199461 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-d8c4f101-bbd2-410f-8d39-04e27a2334bf tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:36.199461 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-d8c4f101-bbd2-410f-8d39-04e27a2334bf tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:36.199461 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-d8c4f101-bbd2-410f-8d39-04e27a2334bf tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:36.209115 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-dd911261-5486-4440-8664-d1a64c58d767 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b690a952a1704197baf5e653e27160f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0fd34670674906aa9a61200251b76c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:48:36.216421 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-dd911261-5486-4440-8664-d1a64c58d767 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] 10.222.0.30 "GET /compute/v2.1/servers/91615e87-1e43-4d69-baab-d7af897d1ac3" status: 200 len: 1265 microversion: 2.1 time: 0.150894 Dec 24 10:48:36.217153 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 343/680] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:48:36 2021] GET /compute/v2.1/servers/91615e87-1e43-4d69-baab-d7af897d1ac3 => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 24 10:48:36.326289 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-d8c4f101-bbd2-410f-8d39-04e27a2334bf tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d627b760f74f48ac560e2ce2e74e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '378bb44ad89440e49f7e290a5d31004e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:48:36.333616 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-d8c4f101-bbd2-410f-8d39-04e27a2334bf tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] 10.222.0.30 "GET /compute/v2.1/servers/54d2f913-8385-4f34-8cb0-8c0f08c7a30f" status: 200 len: 1522 microversion: 2.1 time: 0.147358 Dec 24 10:48:36.334186 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 338/681] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:48:36 2021] GET /compute/v2.1/servers/54d2f913-8385-4f34-8cb0-8c0f08c7a30f => generated 1522 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 24 10:48:36.687172 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-2b0347ea-0c41-49e3-b65f-5fa48f81d2b4 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:48:36.687776 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-2b0347ea-0c41-49e3-b65f-5fa48f81d2b4 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] [instance: a99a6a98-4010-4f8e-a83f-fcc490f6ece0] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:48:36.693903 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-2b0347ea-0c41-49e3-b65f-5fa48f81d2b4 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:36.694346 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-2b0347ea-0c41-49e3-b65f-5fa48f81d2b4 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:36.695113 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-2b0347ea-0c41-49e3-b65f-5fa48f81d2b4 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:36.695540 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-2b0347ea-0c41-49e3-b65f-5fa48f81d2b4 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:36.825650 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-2b0347ea-0c41-49e3-b65f-5fa48f81d2b4 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:48:36.834520 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-2b0347ea-0c41-49e3-b65f-5fa48f81d2b4 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:48:36.838305 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-2b0347ea-0c41-49e3-b65f-5fa48f81d2b4 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:48:36.838305 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-2b0347ea-0c41-49e3-b65f-5fa48f81d2b4 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] 10.222.0.30 "GET /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0" status: 200 len: 1808 microversion: 2.20 time: 0.153588 Dec 24 10:48:36.838305 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 344/682] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Dec 24 10:48:36 2021] GET /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0 => generated 1808 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 24 10:48:36.991217 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-1851d253-448d-462a-b9ec-16ac45a092bb tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:48:36.991764 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-1851d253-448d-462a-b9ec-16ac45a092bb tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] [instance: 6427d66b-d1b3-4cc1-ba3e-f8a8c479189c] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:48:36.998162 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-1851d253-448d-462a-b9ec-16ac45a092bb tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:36.998608 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-1851d253-448d-462a-b9ec-16ac45a092bb tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:36.999381 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-1851d253-448d-462a-b9ec-16ac45a092bb tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:36.999816 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-1851d253-448d-462a-b9ec-16ac45a092bb tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:37.013064 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.wsgi [None req-1851d253-448d-462a-b9ec-16ac45a092bb tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] HTTP exception thrown: Instance 6427d66b-d1b3-4cc1-ba3e-f8a8c479189c could not be found. Dec 24 10:48:37.013645 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-1851d253-448d-462a-b9ec-16ac45a092bb tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Returning 404 to user: Instance 6427d66b-d1b3-4cc1-ba3e-f8a8c479189c could not be found. {{(pid=123431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 24 10:48:37.014472 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-1851d253-448d-462a-b9ec-16ac45a092bb tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] 10.222.0.30 "GET /compute/v2.1/servers/6427d66b-d1b3-4cc1-ba3e-f8a8c479189c" status: 404 len: 111 microversion: 2.1 time: 0.027005 Dec 24 10:48:37.014964 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 339/683] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:48:36 2021] GET /compute/v2.1/servers/6427d66b-d1b3-4cc1-ba3e-f8a8c479189c => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 24 10:48:37.234397 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-1ffcf488-a95d-4444-bbaf-99061cc0dfc2 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:48:37.235489 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-1ffcf488-a95d-4444-bbaf-99061cc0dfc2 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] [instance: 91615e87-1e43-4d69-baab-d7af897d1ac3] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:48:37.241430 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-1ffcf488-a95d-4444-bbaf-99061cc0dfc2 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:37.241813 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-1ffcf488-a95d-4444-bbaf-99061cc0dfc2 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:37.242581 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-1ffcf488-a95d-4444-bbaf-99061cc0dfc2 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:37.243007 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-1ffcf488-a95d-4444-bbaf-99061cc0dfc2 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:37.350848 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-c8c0b633-3a43-441c-84ce-2fa1af32eee6 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:48:37.351459 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-c8c0b633-3a43-441c-84ce-2fa1af32eee6 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] [instance: 54d2f913-8385-4f34-8cb0-8c0f08c7a30f] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:48:37.357488 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-c8c0b633-3a43-441c-84ce-2fa1af32eee6 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:37.357942 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-c8c0b633-3a43-441c-84ce-2fa1af32eee6 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:37.358725 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-c8c0b633-3a43-441c-84ce-2fa1af32eee6 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:37.359161 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-c8c0b633-3a43-441c-84ce-2fa1af32eee6 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:37.393811 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-1ffcf488-a95d-4444-bbaf-99061cc0dfc2 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b690a952a1704197baf5e653e27160f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0fd34670674906aa9a61200251b76c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:48:37.402643 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-1ffcf488-a95d-4444-bbaf-99061cc0dfc2 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] 10.222.0.30 "GET /compute/v2.1/servers/91615e87-1e43-4d69-baab-d7af897d1ac3" status: 200 len: 1265 microversion: 2.1 time: 0.171979 Dec 24 10:48:37.403397 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 345/684] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:48:37 2021] GET /compute/v2.1/servers/91615e87-1e43-4d69-baab-d7af897d1ac3 => generated 1265 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:48:37.499615 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-c8c0b633-3a43-441c-84ce-2fa1af32eee6 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d627b760f74f48ac560e2ce2e74e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '378bb44ad89440e49f7e290a5d31004e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:48:37.508042 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-c8c0b633-3a43-441c-84ce-2fa1af32eee6 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] 10.222.0.30 "GET /compute/v2.1/servers/54d2f913-8385-4f34-8cb0-8c0f08c7a30f" status: 200 len: 1522 microversion: 2.1 time: 0.161388 Dec 24 10:48:37.516552 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 340/685] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:48:37 2021] GET /compute/v2.1/servers/54d2f913-8385-4f34-8cb0-8c0f08c7a30f => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 24 10:48:37.855266 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-4c16e08a-6ea9-4890-a12e-4cafe5c76b42 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:48:37.855901 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-4c16e08a-6ea9-4890-a12e-4cafe5c76b42 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] [instance: a99a6a98-4010-4f8e-a83f-fcc490f6ece0] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:48:37.863159 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-4c16e08a-6ea9-4890-a12e-4cafe5c76b42 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:37.863649 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-4c16e08a-6ea9-4890-a12e-4cafe5c76b42 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:37.864429 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-4c16e08a-6ea9-4890-a12e-4cafe5c76b42 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:37.864889 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-4c16e08a-6ea9-4890-a12e-4cafe5c76b42 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:37.996222 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-4c16e08a-6ea9-4890-a12e-4cafe5c76b42 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:48:38.004595 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-4c16e08a-6ea9-4890-a12e-4cafe5c76b42 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:48:38.006116 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-4c16e08a-6ea9-4890-a12e-4cafe5c76b42 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:48:38.007262 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-4c16e08a-6ea9-4890-a12e-4cafe5c76b42 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] 10.222.0.30 "GET /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0" status: 200 len: 1808 microversion: 2.20 time: 0.155887 Dec 24 10:48:38.007825 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 346/686] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Dec 24 10:48:37 2021] GET /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0 => generated 1808 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 10:48:38.353722 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-93507c0c-5ddf-4392-a697-8473f8ce5c17 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:48:38.354215 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-93507c0c-5ddf-4392-a697-8473f8ce5c17 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] [instance: b18ab8db-0c1f-4343-ae07-953fc820b211] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:48:38.360980 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-93507c0c-5ddf-4392-a697-8473f8ce5c17 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:38.361427 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-93507c0c-5ddf-4392-a697-8473f8ce5c17 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:38.362192 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-93507c0c-5ddf-4392-a697-8473f8ce5c17 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:38.362619 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-93507c0c-5ddf-4392-a697-8473f8ce5c17 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:38.385746 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-93507c0c-5ddf-4392-a697-8473f8ce5c17 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] [instance: b18ab8db-0c1f-4343-ae07-953fc820b211] Going to try to terminate instance {{(pid=123431) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 24 10:48:38.422403 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-4b60d6b1-acb0-45e1-af3b-0d7f4118bc60 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:48:38.423581 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-4b60d6b1-acb0-45e1-af3b-0d7f4118bc60 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] [instance: 91615e87-1e43-4d69-baab-d7af897d1ac3] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:48:38.429347 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-4b60d6b1-acb0-45e1-af3b-0d7f4118bc60 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:38.429798 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-4b60d6b1-acb0-45e1-af3b-0d7f4118bc60 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:38.430572 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-4b60d6b1-acb0-45e1-af3b-0d7f4118bc60 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:38.431043 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-4b60d6b1-acb0-45e1-af3b-0d7f4118bc60 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:38.560245 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-4b60d6b1-acb0-45e1-af3b-0d7f4118bc60 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b690a952a1704197baf5e653e27160f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0fd34670674906aa9a61200251b76c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:48:38.567549 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-4b60d6b1-acb0-45e1-af3b-0d7f4118bc60 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] 10.222.0.30 "GET /compute/v2.1/servers/91615e87-1e43-4d69-baab-d7af897d1ac3" status: 200 len: 1265 microversion: 2.1 time: 0.148793 Dec 24 10:48:38.568109 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 347/687] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:48:38 2021] GET /compute/v2.1/servers/91615e87-1e43-4d69-baab-d7af897d1ac3 => generated 1265 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 24 10:48:38.572222 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-f9dcec64-ec19-4500-8f6e-f35215f21533 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:48:38.572840 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-f9dcec64-ec19-4500-8f6e-f35215f21533 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] [instance: 54d2f913-8385-4f34-8cb0-8c0f08c7a30f] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:48:38.578265 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-f9dcec64-ec19-4500-8f6e-f35215f21533 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:38.578709 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-f9dcec64-ec19-4500-8f6e-f35215f21533 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:38.579484 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-f9dcec64-ec19-4500-8f6e-f35215f21533 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:38.579922 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-f9dcec64-ec19-4500-8f6e-f35215f21533 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:38.694048 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-93507c0c-5ddf-4392-a697-8473f8ce5c17 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] 10.222.0.30 "DELETE /compute/v2.1/servers/b18ab8db-0c1f-4343-ae07-953fc820b211" status: 204 len: 0 microversion: 2.1 time: 0.343606 Dec 24 10:48:38.697755 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 341/688] 10.222.0.30 () {58 vars in 1238 bytes} [Fri Dec 24 10:48:38 2021] DELETE /compute/v2.1/servers/b18ab8db-0c1f-4343-ae07-953fc820b211 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 24 10:48:38.702922 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-9d777da3-4bd7-4362-9a83-c2c53fa927ca tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:48:38.703610 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-9d777da3-4bd7-4362-9a83-c2c53fa927ca tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] [instance: b18ab8db-0c1f-4343-ae07-953fc820b211] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:48:38.709957 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-9d777da3-4bd7-4362-9a83-c2c53fa927ca tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:38.710145 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-f9dcec64-ec19-4500-8f6e-f35215f21533 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d627b760f74f48ac560e2ce2e74e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '378bb44ad89440e49f7e290a5d31004e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:48:38.710397 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-9d777da3-4bd7-4362-9a83-c2c53fa927ca tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:38.711169 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-9d777da3-4bd7-4362-9a83-c2c53fa927ca tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:38.711595 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-9d777da3-4bd7-4362-9a83-c2c53fa927ca tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:38.717460 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-f9dcec64-ec19-4500-8f6e-f35215f21533 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] 10.222.0.30 "GET /compute/v2.1/servers/54d2f913-8385-4f34-8cb0-8c0f08c7a30f" status: 200 len: 1522 microversion: 2.1 time: 0.148397 Dec 24 10:48:38.718028 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 348/689] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:48:38 2021] GET /compute/v2.1/servers/54d2f913-8385-4f34-8cb0-8c0f08c7a30f => generated 1522 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:48:38.842015 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-9d777da3-4bd7-4362-9a83-c2c53fa927ca tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ad5096717dc425c849dfe95ea55a6af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62d11172cdf4959a15ac1ffc5601aca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:48:38.849980 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-9d777da3-4bd7-4362-9a83-c2c53fa927ca tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] 10.222.0.30 "GET /compute/v2.1/servers/b18ab8db-0c1f-4343-ae07-953fc820b211" status: 200 len: 1512 microversion: 2.1 time: 0.151092 Dec 24 10:48:38.850535 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 342/690] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:48:38 2021] GET /compute/v2.1/servers/b18ab8db-0c1f-4343-ae07-953fc820b211 => generated 1512 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:48:39.025883 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-735f5b27-8636-4175-b5bb-a81adbf16277 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:48:39.026485 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-735f5b27-8636-4175-b5bb-a81adbf16277 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] [instance: a99a6a98-4010-4f8e-a83f-fcc490f6ece0] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:48:39.033760 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-735f5b27-8636-4175-b5bb-a81adbf16277 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:39.034205 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-735f5b27-8636-4175-b5bb-a81adbf16277 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:39.034974 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-735f5b27-8636-4175-b5bb-a81adbf16277 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:39.035402 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-735f5b27-8636-4175-b5bb-a81adbf16277 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:39.171830 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-735f5b27-8636-4175-b5bb-a81adbf16277 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:48:39.180440 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-735f5b27-8636-4175-b5bb-a81adbf16277 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:48:39.181991 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-735f5b27-8636-4175-b5bb-a81adbf16277 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:48:39.183142 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-735f5b27-8636-4175-b5bb-a81adbf16277 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] 10.222.0.30 "GET /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0" status: 200 len: 1808 microversion: 2.20 time: 0.160976 Dec 24 10:48:39.183697 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 349/691] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Dec 24 10:48:39 2021] GET /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0 => generated 1808 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 10:48:39.431162 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [req-96c22698-5638-430e-a85d-68116ce1dfb9 req-9d6044ae-5cc0-4dc0-8933-22e1417c4e84 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a99a6a98-4010-4f8e-a83f-fcc490f6ece0", "name": "network-vif-plugged", "status": "completed", "tag": "e50dfc57-62cb-4d13-9e17-f48edcdb1dcc"}]} {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:48:39.433334 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 10:48:39.433334 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: warnings.warn(msg) Dec 24 10:48:39.441265 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [req-96c22698-5638-430e-a85d-68116ce1dfb9 req-9d6044ae-5cc0-4dc0-8933-22e1417c4e84 service nova] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:39.441695 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [req-96c22698-5638-430e-a85d-68116ce1dfb9 req-9d6044ae-5cc0-4dc0-8933-22e1417c4e84 service nova] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:39.452039 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.compute.server_external_events [req-96c22698-5638-430e-a85d-68116ce1dfb9 req-9d6044ae-5cc0-4dc0-8933-22e1417c4e84 service nova] Creating event network-vif-plugged:e50dfc57-62cb-4d13-9e17-f48edcdb1dcc for instance a99a6a98-4010-4f8e-a83f-fcc490f6ece0 on hv-cinder-81644 Dec 24 10:48:39.457197 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [req-96c22698-5638-430e-a85d-68116ce1dfb9 req-9d6044ae-5cc0-4dc0-8933-22e1417c4e84 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029495 Dec 24 10:48:39.457769 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 343/692] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Dec 24 10:48:39 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 10:48:39.585768 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-53221d09-a2d7-4b03-99c9-7f9af340e371 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:48:39.586350 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-53221d09-a2d7-4b03-99c9-7f9af340e371 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] [instance: 91615e87-1e43-4d69-baab-d7af897d1ac3] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:48:39.592396 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-53221d09-a2d7-4b03-99c9-7f9af340e371 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:39.592869 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-53221d09-a2d7-4b03-99c9-7f9af340e371 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:39.593900 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-53221d09-a2d7-4b03-99c9-7f9af340e371 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:39.594361 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-53221d09-a2d7-4b03-99c9-7f9af340e371 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:39.733084 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-53221d09-a2d7-4b03-99c9-7f9af340e371 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b690a952a1704197baf5e653e27160f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0fd34670674906aa9a61200251b76c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:48:39.735540 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-bace6772-0bc8-4f39-83ba-d85a379defba tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:48:39.735540 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-bace6772-0bc8-4f39-83ba-d85a379defba tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] [instance: 54d2f913-8385-4f34-8cb0-8c0f08c7a30f] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:48:39.736858 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-53221d09-a2d7-4b03-99c9-7f9af340e371 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] 10.222.0.30 "GET /compute/v2.1/servers/91615e87-1e43-4d69-baab-d7af897d1ac3" status: 200 len: 1265 microversion: 2.1 time: 0.156374 Dec 24 10:48:39.737451 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 350/693] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:48:39 2021] GET /compute/v2.1/servers/91615e87-1e43-4d69-baab-d7af897d1ac3 => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:48:39.741445 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-bace6772-0bc8-4f39-83ba-d85a379defba tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:39.741892 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-bace6772-0bc8-4f39-83ba-d85a379defba tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:39.742673 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-bace6772-0bc8-4f39-83ba-d85a379defba tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:39.743316 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-bace6772-0bc8-4f39-83ba-d85a379defba tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:39.867026 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-a7b3671d-be07-4c7d-8951-1f3b9d7b63cc tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:48:39.867631 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-a7b3671d-be07-4c7d-8951-1f3b9d7b63cc tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] [instance: b18ab8db-0c1f-4343-ae07-953fc820b211] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:48:39.873373 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-a7b3671d-be07-4c7d-8951-1f3b9d7b63cc tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:39.873821 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-a7b3671d-be07-4c7d-8951-1f3b9d7b63cc tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:39.874607 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-a7b3671d-be07-4c7d-8951-1f3b9d7b63cc tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:39.875036 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-a7b3671d-be07-4c7d-8951-1f3b9d7b63cc tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:39.878345 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-bace6772-0bc8-4f39-83ba-d85a379defba tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d627b760f74f48ac560e2ce2e74e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '378bb44ad89440e49f7e290a5d31004e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:48:39.885806 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-bace6772-0bc8-4f39-83ba-d85a379defba tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] 10.222.0.30 "GET /compute/v2.1/servers/54d2f913-8385-4f34-8cb0-8c0f08c7a30f" status: 200 len: 1522 microversion: 2.1 time: 0.155446 Dec 24 10:48:39.887679 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 344/694] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:48:39 2021] GET /compute/v2.1/servers/54d2f913-8385-4f34-8cb0-8c0f08c7a30f => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 24 10:48:40.005704 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-a7b3671d-be07-4c7d-8951-1f3b9d7b63cc tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ad5096717dc425c849dfe95ea55a6af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62d11172cdf4959a15ac1ffc5601aca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:48:40.012957 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-a7b3671d-be07-4c7d-8951-1f3b9d7b63cc tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] 10.222.0.30 "GET /compute/v2.1/servers/b18ab8db-0c1f-4343-ae07-953fc820b211" status: 200 len: 1512 microversion: 2.1 time: 0.149579 Dec 24 10:48:40.013543 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 351/695] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:48:39 2021] GET /compute/v2.1/servers/b18ab8db-0c1f-4343-ae07-953fc820b211 => generated 1512 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 24 10:48:40.201526 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-50badec8-4a29-4867-8b90-052709fe1109 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:48:40.202117 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-50badec8-4a29-4867-8b90-052709fe1109 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] [instance: a99a6a98-4010-4f8e-a83f-fcc490f6ece0] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:48:40.207895 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-50badec8-4a29-4867-8b90-052709fe1109 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:40.208267 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-50badec8-4a29-4867-8b90-052709fe1109 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:40.209086 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-50badec8-4a29-4867-8b90-052709fe1109 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:40.209497 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-50badec8-4a29-4867-8b90-052709fe1109 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:40.358823 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-50badec8-4a29-4867-8b90-052709fe1109 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:48:40.367539 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-50badec8-4a29-4867-8b90-052709fe1109 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:48:40.369055 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-50badec8-4a29-4867-8b90-052709fe1109 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:48:40.370243 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-50badec8-4a29-4867-8b90-052709fe1109 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] 10.222.0.30 "GET /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0" status: 200 len: 1808 microversion: 2.20 time: 0.172444 Dec 24 10:48:40.370793 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 345/696] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Dec 24 10:48:40 2021] GET /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0 => generated 1808 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 10:48:40.752369 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-4a2fff71-5b25-48e7-9376-65e9bcc40cfc tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:48:40.753009 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-4a2fff71-5b25-48e7-9376-65e9bcc40cfc tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] [instance: 91615e87-1e43-4d69-baab-d7af897d1ac3] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:48:40.759362 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-4a2fff71-5b25-48e7-9376-65e9bcc40cfc tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:40.760255 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-4a2fff71-5b25-48e7-9376-65e9bcc40cfc tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:40.760572 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-4a2fff71-5b25-48e7-9376-65e9bcc40cfc tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:40.761039 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-4a2fff71-5b25-48e7-9376-65e9bcc40cfc tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:40.888308 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-4a2fff71-5b25-48e7-9376-65e9bcc40cfc tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b690a952a1704197baf5e653e27160f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0fd34670674906aa9a61200251b76c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:48:40.895758 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-4a2fff71-5b25-48e7-9376-65e9bcc40cfc tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] 10.222.0.30 "GET /compute/v2.1/servers/91615e87-1e43-4d69-baab-d7af897d1ac3" status: 200 len: 1265 microversion: 2.1 time: 0.146999 Dec 24 10:48:40.896593 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 352/697] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:48:40 2021] GET /compute/v2.1/servers/91615e87-1e43-4d69-baab-d7af897d1ac3 => generated 1265 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:48:40.902263 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-4a3beba6-70e5-4b52-abbf-d7ae01bdd627 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:48:40.904947 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-4a3beba6-70e5-4b52-abbf-d7ae01bdd627 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] [instance: 54d2f913-8385-4f34-8cb0-8c0f08c7a30f] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:48:40.911769 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-4a3beba6-70e5-4b52-abbf-d7ae01bdd627 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:40.912206 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-4a3beba6-70e5-4b52-abbf-d7ae01bdd627 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:40.913004 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-4a3beba6-70e5-4b52-abbf-d7ae01bdd627 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:40.913431 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-4a3beba6-70e5-4b52-abbf-d7ae01bdd627 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:41.030203 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-ff756606-b52d-43b8-be82-a568cfdbfe57 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:48:41.030764 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-ff756606-b52d-43b8-be82-a568cfdbfe57 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] [instance: b18ab8db-0c1f-4343-ae07-953fc820b211] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:48:41.037058 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-ff756606-b52d-43b8-be82-a568cfdbfe57 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:41.037505 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-ff756606-b52d-43b8-be82-a568cfdbfe57 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:41.038291 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-ff756606-b52d-43b8-be82-a568cfdbfe57 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:41.038720 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-ff756606-b52d-43b8-be82-a568cfdbfe57 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:41.040627 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-4a3beba6-70e5-4b52-abbf-d7ae01bdd627 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d627b760f74f48ac560e2ce2e74e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '378bb44ad89440e49f7e290a5d31004e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:48:41.047900 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-4a3beba6-70e5-4b52-abbf-d7ae01bdd627 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] 10.222.0.30 "GET /compute/v2.1/servers/54d2f913-8385-4f34-8cb0-8c0f08c7a30f" status: 200 len: 1522 microversion: 2.1 time: 0.149209 Dec 24 10:48:41.048594 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 346/698] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:48:40 2021] GET /compute/v2.1/servers/54d2f913-8385-4f34-8cb0-8c0f08c7a30f => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:48:41.171463 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-ff756606-b52d-43b8-be82-a568cfdbfe57 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ad5096717dc425c849dfe95ea55a6af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62d11172cdf4959a15ac1ffc5601aca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:48:41.178607 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-ff756606-b52d-43b8-be82-a568cfdbfe57 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] 10.222.0.30 "GET /compute/v2.1/servers/b18ab8db-0c1f-4343-ae07-953fc820b211" status: 200 len: 1512 microversion: 2.1 time: 0.152050 Dec 24 10:48:41.179172 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 353/699] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:48:41 2021] GET /compute/v2.1/servers/b18ab8db-0c1f-4343-ae07-953fc820b211 => generated 1512 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 24 10:48:41.387757 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-377e9099-e90f-4686-a758-b903dc0f7d5d tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:48:41.388361 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-377e9099-e90f-4686-a758-b903dc0f7d5d tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] [instance: a99a6a98-4010-4f8e-a83f-fcc490f6ece0] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:48:41.394670 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-377e9099-e90f-4686-a758-b903dc0f7d5d tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:41.395110 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-377e9099-e90f-4686-a758-b903dc0f7d5d tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:41.396136 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-377e9099-e90f-4686-a758-b903dc0f7d5d tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:41.396568 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-377e9099-e90f-4686-a758-b903dc0f7d5d tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:41.525789 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-377e9099-e90f-4686-a758-b903dc0f7d5d tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:48:41.534019 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-377e9099-e90f-4686-a758-b903dc0f7d5d tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:48:41.535495 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-377e9099-e90f-4686-a758-b903dc0f7d5d tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:48:41.536632 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-377e9099-e90f-4686-a758-b903dc0f7d5d tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] 10.222.0.30 "GET /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0" status: 200 len: 1808 microversion: 2.20 time: 0.152542 Dec 24 10:48:41.537232 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 347/700] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Dec 24 10:48:41 2021] GET /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0 => generated 1808 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 10:48:41.912286 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-3a65a8d1-fb71-47ea-af90-e1f0ba2f049e tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:48:41.912934 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-3a65a8d1-fb71-47ea-af90-e1f0ba2f049e tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] [instance: 91615e87-1e43-4d69-baab-d7af897d1ac3] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:48:41.919264 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-3a65a8d1-fb71-47ea-af90-e1f0ba2f049e tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:41.919701 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-3a65a8d1-fb71-47ea-af90-e1f0ba2f049e tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:41.920480 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-3a65a8d1-fb71-47ea-af90-e1f0ba2f049e tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:41.920957 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-3a65a8d1-fb71-47ea-af90-e1f0ba2f049e tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:42.065101 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-849c93cd-dbfa-4a8f-b9d4-5f1abcdc4536 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:48:42.066469 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-849c93cd-dbfa-4a8f-b9d4-5f1abcdc4536 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] [instance: 54d2f913-8385-4f34-8cb0-8c0f08c7a30f] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:48:42.073144 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-849c93cd-dbfa-4a8f-b9d4-5f1abcdc4536 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:42.073349 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-3a65a8d1-fb71-47ea-af90-e1f0ba2f049e tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b690a952a1704197baf5e653e27160f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0fd34670674906aa9a61200251b76c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:48:42.074086 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-849c93cd-dbfa-4a8f-b9d4-5f1abcdc4536 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:42.075108 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-849c93cd-dbfa-4a8f-b9d4-5f1abcdc4536 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:42.075643 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-849c93cd-dbfa-4a8f-b9d4-5f1abcdc4536 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:42.083949 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-3a65a8d1-fb71-47ea-af90-e1f0ba2f049e tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] 10.222.0.30 "GET /compute/v2.1/servers/91615e87-1e43-4d69-baab-d7af897d1ac3" status: 200 len: 1265 microversion: 2.1 time: 0.175106 Dec 24 10:48:42.084978 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 354/701] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:48:41 2021] GET /compute/v2.1/servers/91615e87-1e43-4d69-baab-d7af897d1ac3 => generated 1265 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:48:42.195676 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-1a5c1b5f-68d1-4f86-b0c8-2b9d179c1811 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:48:42.196683 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-1a5c1b5f-68d1-4f86-b0c8-2b9d179c1811 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] [instance: b18ab8db-0c1f-4343-ae07-953fc820b211] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:48:42.204076 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-1a5c1b5f-68d1-4f86-b0c8-2b9d179c1811 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:42.204743 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-1a5c1b5f-68d1-4f86-b0c8-2b9d179c1811 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:42.206048 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-1a5c1b5f-68d1-4f86-b0c8-2b9d179c1811 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:42.206494 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-1a5c1b5f-68d1-4f86-b0c8-2b9d179c1811 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:42.365401 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-849c93cd-dbfa-4a8f-b9d4-5f1abcdc4536 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d627b760f74f48ac560e2ce2e74e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '378bb44ad89440e49f7e290a5d31004e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:48:42.375368 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-849c93cd-dbfa-4a8f-b9d4-5f1abcdc4536 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] 10.222.0.30 "GET /compute/v2.1/servers/54d2f913-8385-4f34-8cb0-8c0f08c7a30f" status: 200 len: 1522 microversion: 2.1 time: 0.314387 Dec 24 10:48:42.384966 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-1a5c1b5f-68d1-4f86-b0c8-2b9d179c1811 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ad5096717dc425c849dfe95ea55a6af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62d11172cdf4959a15ac1ffc5601aca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:48:42.385948 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 348/702] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:48:42 2021] GET /compute/v2.1/servers/54d2f913-8385-4f34-8cb0-8c0f08c7a30f => generated 1522 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 24 10:48:42.393228 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-1a5c1b5f-68d1-4f86-b0c8-2b9d179c1811 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] 10.222.0.30 "GET /compute/v2.1/servers/b18ab8db-0c1f-4343-ae07-953fc820b211" status: 200 len: 1512 microversion: 2.1 time: 0.201318 Dec 24 10:48:42.393814 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 355/703] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:48:42 2021] GET /compute/v2.1/servers/b18ab8db-0c1f-4343-ae07-953fc820b211 => generated 1512 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:48:42.553957 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-c81f7340-31ad-4994-a425-ec775b1d9702 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:48:42.554693 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-c81f7340-31ad-4994-a425-ec775b1d9702 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] [instance: a99a6a98-4010-4f8e-a83f-fcc490f6ece0] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:48:42.561680 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-c81f7340-31ad-4994-a425-ec775b1d9702 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:42.562204 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-c81f7340-31ad-4994-a425-ec775b1d9702 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:42.563415 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-c81f7340-31ad-4994-a425-ec775b1d9702 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:42.563783 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-c81f7340-31ad-4994-a425-ec775b1d9702 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:42.736597 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-c81f7340-31ad-4994-a425-ec775b1d9702 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:48:42.744859 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-c81f7340-31ad-4994-a425-ec775b1d9702 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:48:42.746331 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-c81f7340-31ad-4994-a425-ec775b1d9702 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:48:42.747464 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-c81f7340-31ad-4994-a425-ec775b1d9702 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] 10.222.0.30 "GET /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0" status: 200 len: 1808 microversion: 2.20 time: 0.197239 Dec 24 10:48:42.748011 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 349/704] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Dec 24 10:48:42 2021] GET /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0 => generated 1808 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 10:48:42.850651 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [req-932006ae-178c-4c90-953a-434c43f58b05 req-f420b3b2-3a95-4d22-8fbb-ca875f1b2934 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b18ab8db-0c1f-4343-ae07-953fc820b211", "name": "network-vif-deleted", "tag": "c73f6a9a-c9cb-49c0-9d7c-7793864fb03a"}]} {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:48:42.850651 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 10:48:42.850651 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: warnings.warn(msg) Dec 24 10:48:42.855136 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [req-932006ae-178c-4c90-953a-434c43f58b05 req-f420b3b2-3a95-4d22-8fbb-ca875f1b2934 service nova] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:42.855606 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [req-932006ae-178c-4c90-953a-434c43f58b05 req-f420b3b2-3a95-4d22-8fbb-ca875f1b2934 service nova] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:42.868647 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.compute.server_external_events [req-932006ae-178c-4c90-953a-434c43f58b05 req-f420b3b2-3a95-4d22-8fbb-ca875f1b2934 service nova] Creating event network-vif-deleted:c73f6a9a-c9cb-49c0-9d7c-7793864fb03a for instance b18ab8db-0c1f-4343-ae07-953fc820b211 on hv-cinder-81644 Dec 24 10:48:42.873394 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [req-932006ae-178c-4c90-953a-434c43f58b05 req-f420b3b2-3a95-4d22-8fbb-ca875f1b2934 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030832 Dec 24 10:48:42.876019 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 356/705] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Dec 24 10:48:42 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 10:48:43.101146 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-c2dd269d-58fb-4b6e-9702-ce1d28d4f279 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:48:43.101756 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-c2dd269d-58fb-4b6e-9702-ce1d28d4f279 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] [instance: 91615e87-1e43-4d69-baab-d7af897d1ac3] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:48:43.107963 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-c2dd269d-58fb-4b6e-9702-ce1d28d4f279 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:43.108412 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-c2dd269d-58fb-4b6e-9702-ce1d28d4f279 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:43.111256 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-c2dd269d-58fb-4b6e-9702-ce1d28d4f279 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:43.111256 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-c2dd269d-58fb-4b6e-9702-ce1d28d4f279 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:43.241995 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-c2dd269d-58fb-4b6e-9702-ce1d28d4f279 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b690a952a1704197baf5e653e27160f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0fd34670674906aa9a61200251b76c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:48:43.249380 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-c2dd269d-58fb-4b6e-9702-ce1d28d4f279 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] 10.222.0.30 "GET /compute/v2.1/servers/91615e87-1e43-4d69-baab-d7af897d1ac3" status: 200 len: 1265 microversion: 2.1 time: 0.151843 Dec 24 10:48:43.250196 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 350/706] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:48:43 2021] GET /compute/v2.1/servers/91615e87-1e43-4d69-baab-d7af897d1ac3 => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:48:43.393250 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-a57933b2-6435-4158-9b02-b75973a0b8bc tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:48:43.393970 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-a57933b2-6435-4158-9b02-b75973a0b8bc tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] [instance: 54d2f913-8385-4f34-8cb0-8c0f08c7a30f] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:48:43.400203 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-a57933b2-6435-4158-9b02-b75973a0b8bc tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:43.400650 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-a57933b2-6435-4158-9b02-b75973a0b8bc tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:43.401471 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-a57933b2-6435-4158-9b02-b75973a0b8bc tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:43.401906 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-a57933b2-6435-4158-9b02-b75973a0b8bc tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:43.413717 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-992beaa2-d708-4337-8058-38bae9e31f1f tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:48:43.414330 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-992beaa2-d708-4337-8058-38bae9e31f1f tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] [instance: b18ab8db-0c1f-4343-ae07-953fc820b211] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:48:43.420225 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-992beaa2-d708-4337-8058-38bae9e31f1f tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:43.420673 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-992beaa2-d708-4337-8058-38bae9e31f1f tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:43.421504 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-992beaa2-d708-4337-8058-38bae9e31f1f tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:43.421943 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-992beaa2-d708-4337-8058-38bae9e31f1f tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:43.452124 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-992beaa2-d708-4337-8058-38bae9e31f1f tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:43.452705 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-992beaa2-d708-4337-8058-38bae9e31f1f tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:43.453193 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.objects.instance [None req-992beaa2-d708-4337-8058-38bae9e31f1f tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lazy-loading 'fault' on Instance uuid b18ab8db-0c1f-4343-ae07-953fc820b211 {{(pid=123431) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 24 10:48:43.493463 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-992beaa2-d708-4337-8058-38bae9e31f1f tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ad5096717dc425c849dfe95ea55a6af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62d11172cdf4959a15ac1ffc5601aca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:48:43.500897 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-992beaa2-d708-4337-8058-38bae9e31f1f tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] 10.222.0.30 "GET /compute/v2.1/servers/b18ab8db-0c1f-4343-ae07-953fc820b211" status: 200 len: 1307 microversion: 2.1 time: 0.090715 Dec 24 10:48:43.502322 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 351/707] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:48:43 2021] GET /compute/v2.1/servers/b18ab8db-0c1f-4343-ae07-953fc820b211 => generated 1307 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 24 10:48:43.551192 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-a57933b2-6435-4158-9b02-b75973a0b8bc tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d627b760f74f48ac560e2ce2e74e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '378bb44ad89440e49f7e290a5d31004e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:48:43.558479 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-a57933b2-6435-4158-9b02-b75973a0b8bc tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] 10.222.0.30 "GET /compute/v2.1/servers/54d2f913-8385-4f34-8cb0-8c0f08c7a30f" status: 200 len: 1522 microversion: 2.1 time: 0.170286 Dec 24 10:48:43.559059 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 357/708] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:48:43 2021] GET /compute/v2.1/servers/54d2f913-8385-4f34-8cb0-8c0f08c7a30f => generated 1522 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:48:43.581704 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [req-0086e3cc-fa68-4db3-bd8e-e6a92175bea5 req-a7cb62ff-aa2b-437f-a074-91b832b063c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91615e87-1e43-4d69-baab-d7af897d1ac3", "name": "network-vif-plugged", "status": "completed", "tag": "85e920ef-bc3e-40d9-a188-7900892566bf"}]} {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:48:43.583450 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 10:48:43.583450 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: warnings.warn(msg) Dec 24 10:48:43.590449 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [req-0086e3cc-fa68-4db3-bd8e-e6a92175bea5 req-a7cb62ff-aa2b-437f-a074-91b832b063c7 service nova] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:43.590888 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [req-0086e3cc-fa68-4db3-bd8e-e6a92175bea5 req-a7cb62ff-aa2b-437f-a074-91b832b063c7 service nova] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:43.601724 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.compute.server_external_events [req-0086e3cc-fa68-4db3-bd8e-e6a92175bea5 req-a7cb62ff-aa2b-437f-a074-91b832b063c7 service nova] Creating event network-vif-plugged:85e920ef-bc3e-40d9-a188-7900892566bf for instance 91615e87-1e43-4d69-baab-d7af897d1ac3 on hv-cinder-81644 Dec 24 10:48:43.606515 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [req-0086e3cc-fa68-4db3-bd8e-e6a92175bea5 req-a7cb62ff-aa2b-437f-a074-91b832b063c7 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028994 Dec 24 10:48:43.607115 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 352/709] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Dec 24 10:48:43 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 10:48:43.765148 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-8c79dab1-7164-42e1-8767-c912d582d763 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:48:43.765748 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-8c79dab1-7164-42e1-8767-c912d582d763 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] [instance: a99a6a98-4010-4f8e-a83f-fcc490f6ece0] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:48:43.772261 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-8c79dab1-7164-42e1-8767-c912d582d763 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:43.772801 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-8c79dab1-7164-42e1-8767-c912d582d763 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:43.773568 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-8c79dab1-7164-42e1-8767-c912d582d763 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:43.773998 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-8c79dab1-7164-42e1-8767-c912d582d763 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:43.906918 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-8c79dab1-7164-42e1-8767-c912d582d763 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:48:43.915502 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-8c79dab1-7164-42e1-8767-c912d582d763 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:48:43.917128 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-8c79dab1-7164-42e1-8767-c912d582d763 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:48:43.918310 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-8c79dab1-7164-42e1-8767-c912d582d763 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] 10.222.0.30 "GET /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0" status: 200 len: 1795 microversion: 2.20 time: 0.157206 Dec 24 10:48:43.919201 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 358/710] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Dec 24 10:48:43 2021] GET /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0 => generated 1795 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 10:48:44.266875 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-21139db4-7fc6-4b01-8291-b0a31b59076c tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:48:44.267563 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-21139db4-7fc6-4b01-8291-b0a31b59076c tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] [instance: 91615e87-1e43-4d69-baab-d7af897d1ac3] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:48:44.273903 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-21139db4-7fc6-4b01-8291-b0a31b59076c tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:44.274347 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-21139db4-7fc6-4b01-8291-b0a31b59076c tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:44.275115 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-21139db4-7fc6-4b01-8291-b0a31b59076c tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:44.275544 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-21139db4-7fc6-4b01-8291-b0a31b59076c tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:44.405061 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-21139db4-7fc6-4b01-8291-b0a31b59076c tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b690a952a1704197baf5e653e27160f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0fd34670674906aa9a61200251b76c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:48:44.412742 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-21139db4-7fc6-4b01-8291-b0a31b59076c tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] 10.222.0.30 "GET /compute/v2.1/servers/91615e87-1e43-4d69-baab-d7af897d1ac3" status: 200 len: 1265 microversion: 2.1 time: 0.150450 Dec 24 10:48:44.413335 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 353/711] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:48:44 2021] GET /compute/v2.1/servers/91615e87-1e43-4d69-baab-d7af897d1ac3 => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:48:44.517721 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-b7ec2282-ea7b-4790-9812-aa31befd9a86 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:48:44.518227 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-b7ec2282-ea7b-4790-9812-aa31befd9a86 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] [instance: b18ab8db-0c1f-4343-ae07-953fc820b211] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:48:44.524769 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-b7ec2282-ea7b-4790-9812-aa31befd9a86 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:44.525239 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-b7ec2282-ea7b-4790-9812-aa31befd9a86 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:44.526000 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-b7ec2282-ea7b-4790-9812-aa31befd9a86 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:44.526429 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-b7ec2282-ea7b-4790-9812-aa31befd9a86 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:44.540575 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.wsgi [None req-b7ec2282-ea7b-4790-9812-aa31befd9a86 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] HTTP exception thrown: Instance b18ab8db-0c1f-4343-ae07-953fc820b211 could not be found. Dec 24 10:48:44.541171 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-b7ec2282-ea7b-4790-9812-aa31befd9a86 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] Returning 404 to user: Instance b18ab8db-0c1f-4343-ae07-953fc820b211 could not be found. {{(pid=123432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 24 10:48:44.541954 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-b7ec2282-ea7b-4790-9812-aa31befd9a86 tempest-AttachVolumeNegativeTest-112891647 tempest-AttachVolumeNegativeTest-112891647-project] 10.222.0.30 "GET /compute/v2.1/servers/b18ab8db-0c1f-4343-ae07-953fc820b211" status: 404 len: 111 microversion: 2.1 time: 0.028087 Dec 24 10:48:44.542467 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 359/712] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:48:44 2021] GET /compute/v2.1/servers/b18ab8db-0c1f-4343-ae07-953fc820b211 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 24 10:48:44.575390 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-c6832e77-70a2-4729-87fc-827c286fdcf6 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:48:44.575989 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-c6832e77-70a2-4729-87fc-827c286fdcf6 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] [instance: 54d2f913-8385-4f34-8cb0-8c0f08c7a30f] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:48:44.581764 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-c6832e77-70a2-4729-87fc-827c286fdcf6 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:44.582366 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-c6832e77-70a2-4729-87fc-827c286fdcf6 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:44.582989 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-c6832e77-70a2-4729-87fc-827c286fdcf6 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:44.583420 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-c6832e77-70a2-4729-87fc-827c286fdcf6 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:44.789432 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-c6832e77-70a2-4729-87fc-827c286fdcf6 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d627b760f74f48ac560e2ce2e74e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '378bb44ad89440e49f7e290a5d31004e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:48:44.796937 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-c6832e77-70a2-4729-87fc-827c286fdcf6 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] 10.222.0.30 "GET /compute/v2.1/servers/54d2f913-8385-4f34-8cb0-8c0f08c7a30f" status: 200 len: 1522 microversion: 2.1 time: 0.225169 Dec 24 10:48:44.797746 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 354/713] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:48:44 2021] GET /compute/v2.1/servers/54d2f913-8385-4f34-8cb0-8c0f08c7a30f => generated 1522 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:48:45.215535 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [req-13f49d15-a6c0-4c77-834d-e8515df9a529 req-2f44f78c-19c8-48aa-a05d-7cc0efed0736 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "54d2f913-8385-4f34-8cb0-8c0f08c7a30f", "name": "network-vif-deleted", "tag": "44345f3a-e246-4a77-8d9d-bd7357043c0b"}]} {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:48:45.217400 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 10:48:45.217400 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: warnings.warn(msg) Dec 24 10:48:45.224646 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [req-13f49d15-a6c0-4c77-834d-e8515df9a529 req-2f44f78c-19c8-48aa-a05d-7cc0efed0736 service nova] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:45.225352 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [req-13f49d15-a6c0-4c77-834d-e8515df9a529 req-2f44f78c-19c8-48aa-a05d-7cc0efed0736 service nova] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:45.236799 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.compute.server_external_events [req-13f49d15-a6c0-4c77-834d-e8515df9a529 req-2f44f78c-19c8-48aa-a05d-7cc0efed0736 service nova] Creating event network-vif-deleted:44345f3a-e246-4a77-8d9d-bd7357043c0b for instance 54d2f913-8385-4f34-8cb0-8c0f08c7a30f on hv-cinder-81644 Dec 24 10:48:45.241540 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [req-13f49d15-a6c0-4c77-834d-e8515df9a529 req-2f44f78c-19c8-48aa-a05d-7cc0efed0736 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029567 Dec 24 10:48:45.242120 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 360/714] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Dec 24 10:48:45 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 10:48:45.429128 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-465cc53b-74b1-470b-ab21-2822d54356e0 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:48:45.429734 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-465cc53b-74b1-470b-ab21-2822d54356e0 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] [instance: 91615e87-1e43-4d69-baab-d7af897d1ac3] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:48:45.435968 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-465cc53b-74b1-470b-ab21-2822d54356e0 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:45.436416 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-465cc53b-74b1-470b-ab21-2822d54356e0 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:45.437228 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-465cc53b-74b1-470b-ab21-2822d54356e0 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:45.437655 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-465cc53b-74b1-470b-ab21-2822d54356e0 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:45.569593 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-465cc53b-74b1-470b-ab21-2822d54356e0 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b690a952a1704197baf5e653e27160f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0fd34670674906aa9a61200251b76c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:48:45.576968 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-465cc53b-74b1-470b-ab21-2822d54356e0 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] 10.222.0.30 "GET /compute/v2.1/servers/91615e87-1e43-4d69-baab-d7af897d1ac3" status: 200 len: 1265 microversion: 2.1 time: 0.151469 Dec 24 10:48:45.577548 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 355/715] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:48:45 2021] GET /compute/v2.1/servers/91615e87-1e43-4d69-baab-d7af897d1ac3 => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:48:45.815176 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-890ceb0b-f232-4809-b86e-669f836fb8d5 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:48:45.815858 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-890ceb0b-f232-4809-b86e-669f836fb8d5 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] [instance: 54d2f913-8385-4f34-8cb0-8c0f08c7a30f] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:48:45.822099 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-890ceb0b-f232-4809-b86e-669f836fb8d5 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:45.827926 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-890ceb0b-f232-4809-b86e-669f836fb8d5 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:45.827926 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-890ceb0b-f232-4809-b86e-669f836fb8d5 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:45.827926 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-890ceb0b-f232-4809-b86e-669f836fb8d5 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:45.855058 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-890ceb0b-f232-4809-b86e-669f836fb8d5 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:45.855161 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-890ceb0b-f232-4809-b86e-669f836fb8d5 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:45.855724 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.objects.instance [None req-890ceb0b-f232-4809-b86e-669f836fb8d5 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lazy-loading 'fault' on Instance uuid 54d2f913-8385-4f34-8cb0-8c0f08c7a30f {{(pid=123432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 24 10:48:45.899160 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-890ceb0b-f232-4809-b86e-669f836fb8d5 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d627b760f74f48ac560e2ce2e74e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '378bb44ad89440e49f7e290a5d31004e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:48:45.907439 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-890ceb0b-f232-4809-b86e-669f836fb8d5 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] 10.222.0.30 "GET /compute/v2.1/servers/54d2f913-8385-4f34-8cb0-8c0f08c7a30f" status: 200 len: 1312 microversion: 2.1 time: 0.096854 Dec 24 10:48:45.908000 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 361/716] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:48:45 2021] GET /compute/v2.1/servers/54d2f913-8385-4f34-8cb0-8c0f08c7a30f => generated 1312 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:48:46.593317 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-2fc0295d-0fc9-40bc-a947-e195fc4c9ac1 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:48:46.593839 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-2fc0295d-0fc9-40bc-a947-e195fc4c9ac1 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] [instance: 91615e87-1e43-4d69-baab-d7af897d1ac3] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:48:46.600254 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-2fc0295d-0fc9-40bc-a947-e195fc4c9ac1 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:46.600793 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-2fc0295d-0fc9-40bc-a947-e195fc4c9ac1 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:46.601612 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-2fc0295d-0fc9-40bc-a947-e195fc4c9ac1 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:46.602129 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-2fc0295d-0fc9-40bc-a947-e195fc4c9ac1 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:46.733893 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-2fc0295d-0fc9-40bc-a947-e195fc4c9ac1 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b690a952a1704197baf5e653e27160f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0fd34670674906aa9a61200251b76c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:48:46.741048 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-2fc0295d-0fc9-40bc-a947-e195fc4c9ac1 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] 10.222.0.30 "GET /compute/v2.1/servers/91615e87-1e43-4d69-baab-d7af897d1ac3" status: 200 len: 1452 microversion: 2.1 time: 0.151382 Dec 24 10:48:46.741629 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 356/717] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:48:46 2021] GET /compute/v2.1/servers/91615e87-1e43-4d69-baab-d7af897d1ac3 => generated 1452 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:48:46.757506 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-205aa054-4980-4099-98c5-fb6a9baa6b1c tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:48:46.758176 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-205aa054-4980-4099-98c5-fb6a9baa6b1c tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] [instance: 91615e87-1e43-4d69-baab-d7af897d1ac3] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:48:46.763750 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-205aa054-4980-4099-98c5-fb6a9baa6b1c tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:46.764190 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-205aa054-4980-4099-98c5-fb6a9baa6b1c tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:46.764983 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-205aa054-4980-4099-98c5-fb6a9baa6b1c tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:46.765438 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-205aa054-4980-4099-98c5-fb6a9baa6b1c tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:46.900462 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-205aa054-4980-4099-98c5-fb6a9baa6b1c tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b690a952a1704197baf5e653e27160f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0fd34670674906aa9a61200251b76c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:48:46.920746 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-205aa054-4980-4099-98c5-fb6a9baa6b1c tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] 10.222.0.30 "GET /compute/v2.1/servers/91615e87-1e43-4d69-baab-d7af897d1ac3" status: 200 len: 1452 microversion: 2.1 time: 0.154119 Dec 24 10:48:46.920746 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 362/718] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:48:46 2021] GET /compute/v2.1/servers/91615e87-1e43-4d69-baab-d7af897d1ac3 => generated 1452 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 24 10:48:46.924311 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-7b92a6d8-81b5-407e-8928-fa9728356c12 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:48:46.925283 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-7b92a6d8-81b5-407e-8928-fa9728356c12 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] [instance: 54d2f913-8385-4f34-8cb0-8c0f08c7a30f] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:48:46.931229 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-7b92a6d8-81b5-407e-8928-fa9728356c12 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:46.931774 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-7b92a6d8-81b5-407e-8928-fa9728356c12 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:46.932557 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-7b92a6d8-81b5-407e-8928-fa9728356c12 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:46.933024 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-7b92a6d8-81b5-407e-8928-fa9728356c12 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:46.947343 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.wsgi [None req-7b92a6d8-81b5-407e-8928-fa9728356c12 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] HTTP exception thrown: Instance 54d2f913-8385-4f34-8cb0-8c0f08c7a30f could not be found. Dec 24 10:48:46.947932 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-7b92a6d8-81b5-407e-8928-fa9728356c12 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] Returning 404 to user: Instance 54d2f913-8385-4f34-8cb0-8c0f08c7a30f could not be found. {{(pid=123431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 24 10:48:46.948917 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-7b92a6d8-81b5-407e-8928-fa9728356c12 tempest-ServerRescueNegativeTestJSON-1238593554 tempest-ServerRescueNegativeTestJSON-1238593554-project] 10.222.0.30 "GET /compute/v2.1/servers/54d2f913-8385-4f34-8cb0-8c0f08c7a30f" status: 404 len: 111 microversion: 2.1 time: 0.029207 Dec 24 10:48:46.949929 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 357/719] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:48:46 2021] GET /compute/v2.1/servers/54d2f913-8385-4f34-8cb0-8c0f08c7a30f => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 24 10:48:49.765007 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [req-78e00a86-392d-448e-8bf2-701ca3944b8b req-2013a7b2-b15e-470e-a610-e74e6959bd7e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "91615e87-1e43-4d69-baab-d7af897d1ac3", "tag": "85e920ef-bc3e-40d9-a188-7900892566bf"}]} {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:48:49.765545 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 10:48:49.765545 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: warnings.warn(msg) Dec 24 10:48:49.775654 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [req-78e00a86-392d-448e-8bf2-701ca3944b8b req-2013a7b2-b15e-470e-a610-e74e6959bd7e service nova] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:49.776108 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [req-78e00a86-392d-448e-8bf2-701ca3944b8b req-2013a7b2-b15e-470e-a610-e74e6959bd7e service nova] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:49.787964 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.compute.server_external_events [req-78e00a86-392d-448e-8bf2-701ca3944b8b req-2013a7b2-b15e-470e-a610-e74e6959bd7e service nova] Creating event network-changed:85e920ef-bc3e-40d9-a188-7900892566bf for instance 91615e87-1e43-4d69-baab-d7af897d1ac3 on hv-cinder-81644 Dec 24 10:48:49.792992 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [req-78e00a86-392d-448e-8bf2-701ca3944b8b req-2013a7b2-b15e-470e-a610-e74e6959bd7e service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034557 Dec 24 10:48:49.794040 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 363/720] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Dec 24 10:48:49 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 10:48:51.743804 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-3f44583f-1748-4003-80d1-3a6d3f2515c6 tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:48:51.748578 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-3f44583f-1748-4003-80d1-3a6d3f2515c6 tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] [instance: 12183d8e-4c50-449a-a93d-cee72f597b3d] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:48:51.752265 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-3f44583f-1748-4003-80d1-3a6d3f2515c6 tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:51.752712 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-3f44583f-1748-4003-80d1-3a6d3f2515c6 tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:51.753528 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-3f44583f-1748-4003-80d1-3a6d3f2515c6 tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:51.753962 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-3f44583f-1748-4003-80d1-3a6d3f2515c6 tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:52.013563 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-3f44583f-1748-4003-80d1-3a6d3f2515c6 tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] 10.222.0.30 "POST /compute/v2.1/servers/12183d8e-4c50-449a-a93d-cee72f597b3d/action" status: 202 len: 0 microversion: 2.1 time: 0.273277 Dec 24 10:48:52.015504 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 358/721] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Dec 24 10:48:51 2021] POST /compute/v2.1/servers/12183d8e-4c50-449a-a93d-cee72f597b3d/action => generated 0 bytes in 275 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 24 10:48:52.026223 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-4c6a56b4-8150-4300-b558-71c87fd1296e tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:48:52.026930 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-4c6a56b4-8150-4300-b558-71c87fd1296e tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] [instance: 12183d8e-4c50-449a-a93d-cee72f597b3d] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:48:52.033568 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-4c6a56b4-8150-4300-b558-71c87fd1296e tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:52.033949 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-4c6a56b4-8150-4300-b558-71c87fd1296e tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:52.034715 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-4c6a56b4-8150-4300-b558-71c87fd1296e tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:52.035143 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-4c6a56b4-8150-4300-b558-71c87fd1296e tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:52.193860 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-4c6a56b4-8150-4300-b558-71c87fd1296e tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e2194bc8c0d44b186956c1b38a0c04a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed29a38d2fe424398ac10e585a980df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:48:52.201666 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-4c6a56b4-8150-4300-b558-71c87fd1296e tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] 10.222.0.30 "GET /compute/v2.1/servers/12183d8e-4c50-449a-a93d-cee72f597b3d" status: 200 len: 1752 microversion: 2.1 time: 0.179842 Dec 24 10:48:52.211339 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 364/722] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:48:52 2021] GET /compute/v2.1/servers/12183d8e-4c50-449a-a93d-cee72f597b3d => generated 1752 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:48:53.219684 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-3ea04361-6706-4ce5-9563-6cb097babfa7 tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:48:53.220392 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-3ea04361-6706-4ce5-9563-6cb097babfa7 tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] [instance: 12183d8e-4c50-449a-a93d-cee72f597b3d] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:48:53.226479 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-3ea04361-6706-4ce5-9563-6cb097babfa7 tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:53.226930 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-3ea04361-6706-4ce5-9563-6cb097babfa7 tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:53.227712 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-3ea04361-6706-4ce5-9563-6cb097babfa7 tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:53.228258 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-3ea04361-6706-4ce5-9563-6cb097babfa7 tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:53.385067 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-3ea04361-6706-4ce5-9563-6cb097babfa7 tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e2194bc8c0d44b186956c1b38a0c04a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed29a38d2fe424398ac10e585a980df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:48:53.393702 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-3ea04361-6706-4ce5-9563-6cb097babfa7 tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] 10.222.0.30 "GET /compute/v2.1/servers/12183d8e-4c50-449a-a93d-cee72f597b3d" status: 200 len: 1757 microversion: 2.1 time: 0.178407 Dec 24 10:48:53.394272 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 359/723] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:48:53 2021] GET /compute/v2.1/servers/12183d8e-4c50-449a-a93d-cee72f597b3d => generated 1757 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:48:54.410670 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-0ca4f2e4-74c5-4528-9aa5-f1ee96bd6700 tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:48:54.411270 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-0ca4f2e4-74c5-4528-9aa5-f1ee96bd6700 tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] [instance: 12183d8e-4c50-449a-a93d-cee72f597b3d] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:48:54.417528 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-0ca4f2e4-74c5-4528-9aa5-f1ee96bd6700 tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:54.417967 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-0ca4f2e4-74c5-4528-9aa5-f1ee96bd6700 tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:54.418740 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-0ca4f2e4-74c5-4528-9aa5-f1ee96bd6700 tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:54.419271 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-0ca4f2e4-74c5-4528-9aa5-f1ee96bd6700 tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:54.563120 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-0ca4f2e4-74c5-4528-9aa5-f1ee96bd6700 tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e2194bc8c0d44b186956c1b38a0c04a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed29a38d2fe424398ac10e585a980df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:48:54.571128 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-0ca4f2e4-74c5-4528-9aa5-f1ee96bd6700 tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] 10.222.0.30 "GET /compute/v2.1/servers/12183d8e-4c50-449a-a93d-cee72f597b3d" status: 200 len: 1757 microversion: 2.1 time: 0.164573 Dec 24 10:48:54.571684 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 365/724] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:48:54 2021] GET /compute/v2.1/servers/12183d8e-4c50-449a-a93d-cee72f597b3d => generated 1757 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 24 10:48:55.587883 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-a4a4fe24-63f1-4074-a235-4074929225b8 tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:48:55.588481 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-a4a4fe24-63f1-4074-a235-4074929225b8 tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] [instance: 12183d8e-4c50-449a-a93d-cee72f597b3d] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:48:55.595281 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-a4a4fe24-63f1-4074-a235-4074929225b8 tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:55.595717 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-a4a4fe24-63f1-4074-a235-4074929225b8 tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:55.596492 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-a4a4fe24-63f1-4074-a235-4074929225b8 tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:55.596945 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-a4a4fe24-63f1-4074-a235-4074929225b8 tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:55.739986 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-a4a4fe24-63f1-4074-a235-4074929225b8 tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e2194bc8c0d44b186956c1b38a0c04a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed29a38d2fe424398ac10e585a980df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:48:55.747671 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-a4a4fe24-63f1-4074-a235-4074929225b8 tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] 10.222.0.30 "GET /compute/v2.1/servers/12183d8e-4c50-449a-a93d-cee72f597b3d" status: 200 len: 1757 microversion: 2.1 time: 0.163440 Dec 24 10:48:55.748225 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 360/725] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:48:55 2021] GET /compute/v2.1/servers/12183d8e-4c50-449a-a93d-cee72f597b3d => generated 1757 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:48:56.763635 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-011d341e-44ae-43bd-8c4e-d5a6b17d7b1c tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:48:56.764245 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-011d341e-44ae-43bd-8c4e-d5a6b17d7b1c tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] [instance: 12183d8e-4c50-449a-a93d-cee72f597b3d] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:48:56.770792 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-011d341e-44ae-43bd-8c4e-d5a6b17d7b1c tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:56.771404 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-011d341e-44ae-43bd-8c4e-d5a6b17d7b1c tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:56.772223 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-011d341e-44ae-43bd-8c4e-d5a6b17d7b1c tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:56.772650 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-011d341e-44ae-43bd-8c4e-d5a6b17d7b1c tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:56.914649 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-011d341e-44ae-43bd-8c4e-d5a6b17d7b1c tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e2194bc8c0d44b186956c1b38a0c04a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed29a38d2fe424398ac10e585a980df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:48:56.923135 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-011d341e-44ae-43bd-8c4e-d5a6b17d7b1c tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] 10.222.0.30 "GET /compute/v2.1/servers/12183d8e-4c50-449a-a93d-cee72f597b3d" status: 200 len: 1757 microversion: 2.1 time: 0.163193 Dec 24 10:48:56.923692 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 366/726] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:48:56 2021] GET /compute/v2.1/servers/12183d8e-4c50-449a-a93d-cee72f597b3d => generated 1757 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:48:57.940236 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-ceeaae30-6094-4f5c-8792-ec0fff4203ca tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:48:57.940845 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-ceeaae30-6094-4f5c-8792-ec0fff4203ca tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] [instance: 12183d8e-4c50-449a-a93d-cee72f597b3d] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:48:57.947003 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-ceeaae30-6094-4f5c-8792-ec0fff4203ca tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:57.947444 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-ceeaae30-6094-4f5c-8792-ec0fff4203ca tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:57.948202 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-ceeaae30-6094-4f5c-8792-ec0fff4203ca tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:57.948628 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-ceeaae30-6094-4f5c-8792-ec0fff4203ca tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:58.103451 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-ceeaae30-6094-4f5c-8792-ec0fff4203ca tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e2194bc8c0d44b186956c1b38a0c04a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed29a38d2fe424398ac10e585a980df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:48:58.111370 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-ceeaae30-6094-4f5c-8792-ec0fff4203ca tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] 10.222.0.30 "GET /compute/v2.1/servers/12183d8e-4c50-449a-a93d-cee72f597b3d" status: 200 len: 1757 microversion: 2.1 time: 0.175293 Dec 24 10:48:58.111938 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 361/727] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:48:57 2021] GET /compute/v2.1/servers/12183d8e-4c50-449a-a93d-cee72f597b3d => generated 1757 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:48:59.127600 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-58bb010a-03ef-4aeb-8f95-c0060263cf09 tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:48:59.128135 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-58bb010a-03ef-4aeb-8f95-c0060263cf09 tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] [instance: 12183d8e-4c50-449a-a93d-cee72f597b3d] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:48:59.134274 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-58bb010a-03ef-4aeb-8f95-c0060263cf09 tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:59.134716 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-58bb010a-03ef-4aeb-8f95-c0060263cf09 tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:59.135487 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-58bb010a-03ef-4aeb-8f95-c0060263cf09 tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:48:59.135912 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-58bb010a-03ef-4aeb-8f95-c0060263cf09 tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:48:59.306549 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-58bb010a-03ef-4aeb-8f95-c0060263cf09 tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e2194bc8c0d44b186956c1b38a0c04a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed29a38d2fe424398ac10e585a980df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:48:59.315261 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-58bb010a-03ef-4aeb-8f95-c0060263cf09 tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] 10.222.0.30 "GET /compute/v2.1/servers/12183d8e-4c50-449a-a93d-cee72f597b3d" status: 200 len: 1757 microversion: 2.1 time: 0.191339 Dec 24 10:48:59.315880 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 367/728] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:48:59 2021] GET /compute/v2.1/servers/12183d8e-4c50-449a-a93d-cee72f597b3d => generated 1757 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:49:00.332247 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-3b2772d6-f06c-4afa-9dcb-1cd64c68873c tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:49:00.332989 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-3b2772d6-f06c-4afa-9dcb-1cd64c68873c tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] [instance: 12183d8e-4c50-449a-a93d-cee72f597b3d] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:49:00.339732 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-3b2772d6-f06c-4afa-9dcb-1cd64c68873c tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:49:00.340173 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-3b2772d6-f06c-4afa-9dcb-1cd64c68873c tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:49:00.340980 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-3b2772d6-f06c-4afa-9dcb-1cd64c68873c tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:49:00.341411 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-3b2772d6-f06c-4afa-9dcb-1cd64c68873c tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:49:00.488768 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-3b2772d6-f06c-4afa-9dcb-1cd64c68873c tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e2194bc8c0d44b186956c1b38a0c04a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed29a38d2fe424398ac10e585a980df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:49:00.496777 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-3b2772d6-f06c-4afa-9dcb-1cd64c68873c tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] 10.222.0.30 "GET /compute/v2.1/servers/12183d8e-4c50-449a-a93d-cee72f597b3d" status: 200 len: 1757 microversion: 2.1 time: 0.168554 Dec 24 10:49:00.497373 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 362/729] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:49:00 2021] GET /compute/v2.1/servers/12183d8e-4c50-449a-a93d-cee72f597b3d => generated 1757 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:49:01.513259 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-ef5aae27-e6bb-47b7-b980-b646ccba91d5 tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:49:01.513920 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-ef5aae27-e6bb-47b7-b980-b646ccba91d5 tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] [instance: 12183d8e-4c50-449a-a93d-cee72f597b3d] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:49:01.521479 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-ef5aae27-e6bb-47b7-b980-b646ccba91d5 tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:49:01.522143 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-ef5aae27-e6bb-47b7-b980-b646ccba91d5 tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:49:01.522928 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-ef5aae27-e6bb-47b7-b980-b646ccba91d5 tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:49:01.523364 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-ef5aae27-e6bb-47b7-b980-b646ccba91d5 tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:49:01.668836 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-ef5aae27-e6bb-47b7-b980-b646ccba91d5 tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e2194bc8c0d44b186956c1b38a0c04a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed29a38d2fe424398ac10e585a980df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:49:01.681619 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-ef5aae27-e6bb-47b7-b980-b646ccba91d5 tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] 10.222.0.30 "GET /compute/v2.1/servers/12183d8e-4c50-449a-a93d-cee72f597b3d" status: 200 len: 1757 microversion: 2.1 time: 0.170154 Dec 24 10:49:01.681619 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 368/730] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:49:01 2021] GET /compute/v2.1/servers/12183d8e-4c50-449a-a93d-cee72f597b3d => generated 1757 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:49:02.696596 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-134c525e-861a-4aaf-8baf-c3b59706543f tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:49:02.697231 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-134c525e-861a-4aaf-8baf-c3b59706543f tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] [instance: 12183d8e-4c50-449a-a93d-cee72f597b3d] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:49:02.703462 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-134c525e-861a-4aaf-8baf-c3b59706543f tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:49:02.703907 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-134c525e-861a-4aaf-8baf-c3b59706543f tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:49:02.704689 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-134c525e-861a-4aaf-8baf-c3b59706543f tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:49:02.705157 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-134c525e-861a-4aaf-8baf-c3b59706543f tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:49:02.902323 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-134c525e-861a-4aaf-8baf-c3b59706543f tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e2194bc8c0d44b186956c1b38a0c04a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed29a38d2fe424398ac10e585a980df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:49:02.912341 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-134c525e-861a-4aaf-8baf-c3b59706543f tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] 10.222.0.30 "GET /compute/v2.1/servers/12183d8e-4c50-449a-a93d-cee72f597b3d" status: 200 len: 1757 microversion: 2.1 time: 0.217321 Dec 24 10:49:02.912341 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 363/731] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:49:02 2021] GET /compute/v2.1/servers/12183d8e-4c50-449a-a93d-cee72f597b3d => generated 1757 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:49:03.926054 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-a32730e9-e199-4238-8e8c-6a6f21e13c22 tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:49:03.926834 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-a32730e9-e199-4238-8e8c-6a6f21e13c22 tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] [instance: 12183d8e-4c50-449a-a93d-cee72f597b3d] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:49:03.933505 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-a32730e9-e199-4238-8e8c-6a6f21e13c22 tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:49:03.933956 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-a32730e9-e199-4238-8e8c-6a6f21e13c22 tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:49:03.934750 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-a32730e9-e199-4238-8e8c-6a6f21e13c22 tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:49:03.935184 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-a32730e9-e199-4238-8e8c-6a6f21e13c22 tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:49:04.157982 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-a32730e9-e199-4238-8e8c-6a6f21e13c22 tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e2194bc8c0d44b186956c1b38a0c04a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed29a38d2fe424398ac10e585a980df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:49:04.166138 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-a32730e9-e199-4238-8e8c-6a6f21e13c22 tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] 10.222.0.30 "GET /compute/v2.1/servers/12183d8e-4c50-449a-a93d-cee72f597b3d" status: 200 len: 1757 microversion: 2.1 time: 0.243785 Dec 24 10:49:04.166722 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 369/732] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:49:03 2021] GET /compute/v2.1/servers/12183d8e-4c50-449a-a93d-cee72f597b3d => generated 1757 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:49:05.184711 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-4e17b9eb-fa18-4e9b-9d30-016c0906783a tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:49:05.185570 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-4e17b9eb-fa18-4e9b-9d30-016c0906783a tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] [instance: 12183d8e-4c50-449a-a93d-cee72f597b3d] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:49:05.193320 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-4e17b9eb-fa18-4e9b-9d30-016c0906783a tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:49:05.194025 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-4e17b9eb-fa18-4e9b-9d30-016c0906783a tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:49:05.195069 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-4e17b9eb-fa18-4e9b-9d30-016c0906783a tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:49:05.195758 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-4e17b9eb-fa18-4e9b-9d30-016c0906783a tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:49:05.350793 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-4e17b9eb-fa18-4e9b-9d30-016c0906783a tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e2194bc8c0d44b186956c1b38a0c04a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed29a38d2fe424398ac10e585a980df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:49:05.358710 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-4e17b9eb-fa18-4e9b-9d30-016c0906783a tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] 10.222.0.30 "GET /compute/v2.1/servers/12183d8e-4c50-449a-a93d-cee72f597b3d" status: 200 len: 1757 microversion: 2.1 time: 0.178961 Dec 24 10:49:05.359275 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 364/733] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:49:05 2021] GET /compute/v2.1/servers/12183d8e-4c50-449a-a93d-cee72f597b3d => generated 1757 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:49:06.376209 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-b246bffd-ac3a-41ba-8c13-f3f645500644 tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:49:06.377599 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-b246bffd-ac3a-41ba-8c13-f3f645500644 tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] [instance: 12183d8e-4c50-449a-a93d-cee72f597b3d] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:49:06.384453 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-b246bffd-ac3a-41ba-8c13-f3f645500644 tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:49:06.385200 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-b246bffd-ac3a-41ba-8c13-f3f645500644 tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:49:06.386255 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-b246bffd-ac3a-41ba-8c13-f3f645500644 tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:49:06.386904 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-b246bffd-ac3a-41ba-8c13-f3f645500644 tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:49:06.550719 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-b246bffd-ac3a-41ba-8c13-f3f645500644 tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e2194bc8c0d44b186956c1b38a0c04a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed29a38d2fe424398ac10e585a980df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:49:06.560312 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-b246bffd-ac3a-41ba-8c13-f3f645500644 tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] 10.222.0.30 "GET /compute/v2.1/servers/12183d8e-4c50-449a-a93d-cee72f597b3d" status: 200 len: 1757 microversion: 2.1 time: 0.187959 Dec 24 10:49:06.561298 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 370/734] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:49:06 2021] GET /compute/v2.1/servers/12183d8e-4c50-449a-a93d-cee72f597b3d => generated 1757 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:49:07.577444 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-dfd0d1ed-317f-42ef-8f9f-e85bd92c6903 tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:49:07.578057 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-dfd0d1ed-317f-42ef-8f9f-e85bd92c6903 tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] [instance: 12183d8e-4c50-449a-a93d-cee72f597b3d] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:49:07.584684 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-dfd0d1ed-317f-42ef-8f9f-e85bd92c6903 tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:49:07.585161 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-dfd0d1ed-317f-42ef-8f9f-e85bd92c6903 tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:49:07.585918 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-dfd0d1ed-317f-42ef-8f9f-e85bd92c6903 tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:49:07.586339 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-dfd0d1ed-317f-42ef-8f9f-e85bd92c6903 tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:49:07.730297 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-dfd0d1ed-317f-42ef-8f9f-e85bd92c6903 tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e2194bc8c0d44b186956c1b38a0c04a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed29a38d2fe424398ac10e585a980df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:49:07.737898 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-dfd0d1ed-317f-42ef-8f9f-e85bd92c6903 tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] 10.222.0.30 "GET /compute/v2.1/servers/12183d8e-4c50-449a-a93d-cee72f597b3d" status: 200 len: 1760 microversion: 2.1 time: 0.164065 Dec 24 10:49:07.738454 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 365/735] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:49:07 2021] GET /compute/v2.1/servers/12183d8e-4c50-449a-a93d-cee72f597b3d => generated 1760 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:49:30.592531 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-05596c12-0c0d-402a-b75c-dbdd113a049d tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:49:30.593133 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-05596c12-0c0d-402a-b75c-dbdd113a049d tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] [instance: 9330dbb8-edad-4d54-afeb-8badc464250d] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:49:30.599028 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-05596c12-0c0d-402a-b75c-dbdd113a049d tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:49:30.599481 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-05596c12-0c0d-402a-b75c-dbdd113a049d tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:49:30.600265 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-05596c12-0c0d-402a-b75c-dbdd113a049d tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:49:30.600730 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-05596c12-0c0d-402a-b75c-dbdd113a049d tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:49:30.678810 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.objects.instance [None req-05596c12-0c0d-402a-b75c-dbdd113a049d tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lazy-loading 'services' on Instance uuid 9330dbb8-edad-4d54-afeb-8badc464250d {{(pid=123432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 24 10:49:30.957246 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-05596c12-0c0d-402a-b75c-dbdd113a049d tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] 10.222.0.30 "DELETE /compute/v2.1/servers/9330dbb8-edad-4d54-afeb-8badc464250d/os-volume_attachments/c8a0e2a6-51a9-49bc-96f3-e4e9cb86b83c" status: 202 len: 0 microversion: 2.1 time: 0.369065 Dec 24 10:49:30.957942 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 371/736] 10.222.0.30 () {58 vars in 1415 bytes} [Fri Dec 24 10:49:30 2021] DELETE /compute/v2.1/servers/9330dbb8-edad-4d54-afeb-8badc464250d/os-volume_attachments/c8a0e2a6-51a9-49bc-96f3-e4e9cb86b83c => generated 0 bytes in 371 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 24 10:49:35.210833 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-a9d56482-9c3a-4a94-8d13-7915f099570e tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:49:35.217795 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-a9d56482-9c3a-4a94-8d13-7915f099570e tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:49:35.218621 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-a9d56482-9c3a-4a94-8d13-7915f099570e tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:49:35.241759 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-a9d56482-9c3a-4a94-8d13-7915f099570e tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] [instance: 9330dbb8-edad-4d54-afeb-8badc464250d] Going to try to stop instance {{(pid=123431) force_stop /opt/stack/nova/nova/compute/api.py:2654}} Dec 24 10:49:35.492177 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-a9d56482-9c3a-4a94-8d13-7915f099570e tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] 10.222.0.30 "POST /compute/v2.1/servers/9330dbb8-edad-4d54-afeb-8badc464250d/action" status: 202 len: 0 microversion: 2.1 time: 0.284988 Dec 24 10:49:35.492810 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 366/737] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Dec 24 10:49:35 2021] POST /compute/v2.1/servers/9330dbb8-edad-4d54-afeb-8badc464250d/action => generated 0 bytes in 286 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Dec 24 10:49:35.502207 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-e445e596-6560-442e-b411-663ffb4a5b0c tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:49:35.502905 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-e445e596-6560-442e-b411-663ffb4a5b0c tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] [instance: 9330dbb8-edad-4d54-afeb-8badc464250d] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:49:35.508978 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-e445e596-6560-442e-b411-663ffb4a5b0c tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:49:35.509437 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-e445e596-6560-442e-b411-663ffb4a5b0c tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:49:35.510220 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-e445e596-6560-442e-b411-663ffb4a5b0c tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:49:35.510644 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-e445e596-6560-442e-b411-663ffb4a5b0c tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:49:35.641483 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-e445e596-6560-442e-b411-663ffb4a5b0c tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37516225f9244c969ed168f6a024482a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0115a5cc8b4b1e8bffb84e0f3e0b08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:49:35.649627 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-e445e596-6560-442e-b411-663ffb4a5b0c tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] 10.222.0.30 "GET /compute/v2.1/servers/9330dbb8-edad-4d54-afeb-8badc464250d" status: 200 len: 1678 microversion: 2.1 time: 0.151783 Dec 24 10:49:35.650355 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 372/738] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:49:35 2021] GET /compute/v2.1/servers/9330dbb8-edad-4d54-afeb-8badc464250d => generated 1678 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:49:36.668351 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-02df7e93-39f2-455f-bc57-af473a06a72f tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:49:36.669214 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-02df7e93-39f2-455f-bc57-af473a06a72f tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] [instance: 9330dbb8-edad-4d54-afeb-8badc464250d] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:49:36.675152 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-02df7e93-39f2-455f-bc57-af473a06a72f tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:49:36.675585 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-02df7e93-39f2-455f-bc57-af473a06a72f tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:49:36.676372 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-02df7e93-39f2-455f-bc57-af473a06a72f tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:49:36.676797 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-02df7e93-39f2-455f-bc57-af473a06a72f tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:49:36.809885 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-02df7e93-39f2-455f-bc57-af473a06a72f tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37516225f9244c969ed168f6a024482a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0115a5cc8b4b1e8bffb84e0f3e0b08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:49:36.817440 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-02df7e93-39f2-455f-bc57-af473a06a72f tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] 10.222.0.30 "GET /compute/v2.1/servers/9330dbb8-edad-4d54-afeb-8badc464250d" status: 200 len: 1678 microversion: 2.1 time: 0.153672 Dec 24 10:49:36.818009 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 367/739] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:49:36 2021] GET /compute/v2.1/servers/9330dbb8-edad-4d54-afeb-8badc464250d => generated 1678 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:49:37.834783 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-115454eb-62db-44f1-934b-c0fd08c1c6e6 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:49:37.835803 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-115454eb-62db-44f1-934b-c0fd08c1c6e6 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] [instance: 9330dbb8-edad-4d54-afeb-8badc464250d] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:49:37.842379 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-115454eb-62db-44f1-934b-c0fd08c1c6e6 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:49:37.842824 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-115454eb-62db-44f1-934b-c0fd08c1c6e6 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:49:37.843599 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-115454eb-62db-44f1-934b-c0fd08c1c6e6 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:49:37.844028 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-115454eb-62db-44f1-934b-c0fd08c1c6e6 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:49:37.974147 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-115454eb-62db-44f1-934b-c0fd08c1c6e6 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37516225f9244c969ed168f6a024482a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0115a5cc8b4b1e8bffb84e0f3e0b08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:49:37.981625 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-115454eb-62db-44f1-934b-c0fd08c1c6e6 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] 10.222.0.30 "GET /compute/v2.1/servers/9330dbb8-edad-4d54-afeb-8badc464250d" status: 200 len: 1678 microversion: 2.1 time: 0.150474 Dec 24 10:49:37.982187 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 373/740] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:49:37 2021] GET /compute/v2.1/servers/9330dbb8-edad-4d54-afeb-8badc464250d => generated 1678 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:49:38.998240 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-2c246e65-d560-49fd-8c55-3684997ca196 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:49:38.998873 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-2c246e65-d560-49fd-8c55-3684997ca196 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] [instance: 9330dbb8-edad-4d54-afeb-8badc464250d] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:49:39.005073 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-2c246e65-d560-49fd-8c55-3684997ca196 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:49:39.005508 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-2c246e65-d560-49fd-8c55-3684997ca196 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:49:39.006269 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-2c246e65-d560-49fd-8c55-3684997ca196 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:49:39.006690 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-2c246e65-d560-49fd-8c55-3684997ca196 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:49:39.134590 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-2c246e65-d560-49fd-8c55-3684997ca196 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37516225f9244c969ed168f6a024482a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0115a5cc8b4b1e8bffb84e0f3e0b08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:49:39.141967 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-2c246e65-d560-49fd-8c55-3684997ca196 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] 10.222.0.30 "GET /compute/v2.1/servers/9330dbb8-edad-4d54-afeb-8badc464250d" status: 200 len: 1678 microversion: 2.1 time: 0.147510 Dec 24 10:49:39.142523 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 368/741] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:49:38 2021] GET /compute/v2.1/servers/9330dbb8-edad-4d54-afeb-8badc464250d => generated 1678 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:49:40.158532 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-42d69e5c-b62f-41d4-80c0-83edbed01074 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:49:40.159134 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-42d69e5c-b62f-41d4-80c0-83edbed01074 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] [instance: 9330dbb8-edad-4d54-afeb-8badc464250d] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:49:40.165280 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-42d69e5c-b62f-41d4-80c0-83edbed01074 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:49:40.165714 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-42d69e5c-b62f-41d4-80c0-83edbed01074 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:49:40.166480 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-42d69e5c-b62f-41d4-80c0-83edbed01074 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:49:40.166901 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-42d69e5c-b62f-41d4-80c0-83edbed01074 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:49:40.289858 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-42d69e5c-b62f-41d4-80c0-83edbed01074 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37516225f9244c969ed168f6a024482a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0115a5cc8b4b1e8bffb84e0f3e0b08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:49:40.297641 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-42d69e5c-b62f-41d4-80c0-83edbed01074 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] 10.222.0.30 "GET /compute/v2.1/servers/9330dbb8-edad-4d54-afeb-8badc464250d" status: 200 len: 1678 microversion: 2.1 time: 0.142695 Dec 24 10:49:40.298196 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 374/742] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:49:40 2021] GET /compute/v2.1/servers/9330dbb8-edad-4d54-afeb-8badc464250d => generated 1678 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:49:40.617524 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-0b403d2b-f91a-4445-917e-7788179a5d33 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:49:40.618096 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-0b403d2b-f91a-4445-917e-7788179a5d33 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] [instance: a99a6a98-4010-4f8e-a83f-fcc490f6ece0] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:49:40.624263 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-0b403d2b-f91a-4445-917e-7788179a5d33 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:49:40.624708 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-0b403d2b-f91a-4445-917e-7788179a5d33 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:49:40.625591 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-0b403d2b-f91a-4445-917e-7788179a5d33 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:49:40.626024 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-0b403d2b-f91a-4445-917e-7788179a5d33 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:49:40.654009 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-0b403d2b-f91a-4445-917e-7788179a5d33 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] 10.222.0.30 "GET /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0/os-volume_attachments/6c87b2d9-7ced-4611-89ff-9ca851a392f0" status: 200 len: 194 microversion: 2.20 time: 0.040315 Dec 24 10:49:40.654558 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 369/743] 10.222.0.30 () {60 vars in 1453 bytes} [Fri Dec 24 10:49:40 2021] GET /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0/os-volume_attachments/6c87b2d9-7ced-4611-89ff-9ca851a392f0 => generated 194 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 24 10:49:40.712936 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-ebbb50ed-bd0d-4340-91be-82455f00a652 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:49:40.713422 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-ebbb50ed-bd0d-4340-91be-82455f00a652 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] [instance: a99a6a98-4010-4f8e-a83f-fcc490f6ece0] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:49:40.719737 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-ebbb50ed-bd0d-4340-91be-82455f00a652 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:49:40.720178 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-ebbb50ed-bd0d-4340-91be-82455f00a652 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:49:40.720982 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-ebbb50ed-bd0d-4340-91be-82455f00a652 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:49:40.721409 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-ebbb50ed-bd0d-4340-91be-82455f00a652 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:49:40.797238 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.objects.instance [None req-ebbb50ed-bd0d-4340-91be-82455f00a652 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lazy-loading 'services' on Instance uuid a99a6a98-4010-4f8e-a83f-fcc490f6ece0 {{(pid=123432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 24 10:49:41.090812 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-ebbb50ed-bd0d-4340-91be-82455f00a652 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] 10.222.0.30 "DELETE /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0/os-volume_attachments/6c87b2d9-7ced-4611-89ff-9ca851a392f0" status: 202 len: 0 microversion: 2.20 time: 0.381374 Dec 24 10:49:41.091394 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 375/744] 10.222.0.30 () {60 vars in 1456 bytes} [Fri Dec 24 10:49:40 2021] DELETE /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0/os-volume_attachments/6c87b2d9-7ced-4611-89ff-9ca851a392f0 => generated 0 bytes in 383 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Dec 24 10:49:41.099660 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-c69e4902-bdbb-4b6e-a1fd-0f59386aaeb2 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:49:41.100613 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-c69e4902-bdbb-4b6e-a1fd-0f59386aaeb2 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] [instance: a99a6a98-4010-4f8e-a83f-fcc490f6ece0] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:49:41.106358 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-c69e4902-bdbb-4b6e-a1fd-0f59386aaeb2 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:49:41.106804 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-c69e4902-bdbb-4b6e-a1fd-0f59386aaeb2 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:49:41.107574 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-c69e4902-bdbb-4b6e-a1fd-0f59386aaeb2 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:49:41.108006 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-c69e4902-bdbb-4b6e-a1fd-0f59386aaeb2 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:49:41.137407 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-c69e4902-bdbb-4b6e-a1fd-0f59386aaeb2 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] 10.222.0.30 "GET /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041464 Dec 24 10:49:41.138142 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 370/745] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Dec 24 10:49:41 2021] GET /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 24 10:49:41.315089 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-49ec683c-33f3-4b0f-b636-c450b03465d3 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:49:41.315774 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-49ec683c-33f3-4b0f-b636-c450b03465d3 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] [instance: 9330dbb8-edad-4d54-afeb-8badc464250d] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:49:41.322034 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-49ec683c-33f3-4b0f-b636-c450b03465d3 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:49:41.322506 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-49ec683c-33f3-4b0f-b636-c450b03465d3 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:49:41.323300 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-49ec683c-33f3-4b0f-b636-c450b03465d3 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:49:41.324366 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-49ec683c-33f3-4b0f-b636-c450b03465d3 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:49:41.458583 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-49ec683c-33f3-4b0f-b636-c450b03465d3 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37516225f9244c969ed168f6a024482a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0115a5cc8b4b1e8bffb84e0f3e0b08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:49:41.465840 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-49ec683c-33f3-4b0f-b636-c450b03465d3 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] 10.222.0.30 "GET /compute/v2.1/servers/9330dbb8-edad-4d54-afeb-8badc464250d" status: 200 len: 1678 microversion: 2.1 time: 0.155207 Dec 24 10:49:41.466403 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 376/746] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:49:41 2021] GET /compute/v2.1/servers/9330dbb8-edad-4d54-afeb-8badc464250d => generated 1678 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:49:42.149219 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-d30e0c9f-3e5c-4cec-947d-255d58b872e5 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:49:42.150114 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-d30e0c9f-3e5c-4cec-947d-255d58b872e5 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] [instance: a99a6a98-4010-4f8e-a83f-fcc490f6ece0] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:49:42.156890 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-d30e0c9f-3e5c-4cec-947d-255d58b872e5 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:49:42.157338 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-d30e0c9f-3e5c-4cec-947d-255d58b872e5 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:49:42.158104 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-d30e0c9f-3e5c-4cec-947d-255d58b872e5 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:49:42.158531 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-d30e0c9f-3e5c-4cec-947d-255d58b872e5 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:49:42.186899 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-d30e0c9f-3e5c-4cec-947d-255d58b872e5 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] 10.222.0.30 "GET /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041590 Dec 24 10:49:42.187458 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 371/747] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Dec 24 10:49:42 2021] GET /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 24 10:49:42.483653 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-02652e8f-783b-4448-9899-717dcfba0a68 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:49:42.484231 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-02652e8f-783b-4448-9899-717dcfba0a68 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] [instance: 9330dbb8-edad-4d54-afeb-8badc464250d] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:49:42.490467 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-02652e8f-783b-4448-9899-717dcfba0a68 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:49:42.490902 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-02652e8f-783b-4448-9899-717dcfba0a68 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:49:42.491667 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-02652e8f-783b-4448-9899-717dcfba0a68 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:49:42.492093 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-02652e8f-783b-4448-9899-717dcfba0a68 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:49:42.616614 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-02652e8f-783b-4448-9899-717dcfba0a68 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37516225f9244c969ed168f6a024482a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0115a5cc8b4b1e8bffb84e0f3e0b08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:49:42.623757 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-02652e8f-783b-4448-9899-717dcfba0a68 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] 10.222.0.30 "GET /compute/v2.1/servers/9330dbb8-edad-4d54-afeb-8badc464250d" status: 200 len: 1678 microversion: 2.1 time: 0.144347 Dec 24 10:49:42.624316 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 377/748] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:49:42 2021] GET /compute/v2.1/servers/9330dbb8-edad-4d54-afeb-8badc464250d => generated 1678 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:49:43.198832 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-6fbbecf9-49ac-4abd-9ce6-36de635fdc00 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:49:43.199735 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-6fbbecf9-49ac-4abd-9ce6-36de635fdc00 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] [instance: a99a6a98-4010-4f8e-a83f-fcc490f6ece0] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:49:43.206169 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-6fbbecf9-49ac-4abd-9ce6-36de635fdc00 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:49:43.206616 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-6fbbecf9-49ac-4abd-9ce6-36de635fdc00 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:49:43.207418 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-6fbbecf9-49ac-4abd-9ce6-36de635fdc00 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:49:43.207849 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-6fbbecf9-49ac-4abd-9ce6-36de635fdc00 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:49:43.235953 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-6fbbecf9-49ac-4abd-9ce6-36de635fdc00 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] 10.222.0.30 "GET /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041442 Dec 24 10:49:43.236497 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 372/749] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Dec 24 10:49:43 2021] GET /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 24 10:49:43.640852 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-c31f0be1-ac68-4ddb-b9e0-c1c76f085678 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:49:43.641464 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-c31f0be1-ac68-4ddb-b9e0-c1c76f085678 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] [instance: 9330dbb8-edad-4d54-afeb-8badc464250d] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:49:43.648206 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-c31f0be1-ac68-4ddb-b9e0-c1c76f085678 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:49:43.648697 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-c31f0be1-ac68-4ddb-b9e0-c1c76f085678 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:49:43.649489 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-c31f0be1-ac68-4ddb-b9e0-c1c76f085678 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:49:43.649923 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-c31f0be1-ac68-4ddb-b9e0-c1c76f085678 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:49:43.796725 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-c31f0be1-ac68-4ddb-b9e0-c1c76f085678 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37516225f9244c969ed168f6a024482a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0115a5cc8b4b1e8bffb84e0f3e0b08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:49:43.804395 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-c31f0be1-ac68-4ddb-b9e0-c1c76f085678 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] 10.222.0.30 "GET /compute/v2.1/servers/9330dbb8-edad-4d54-afeb-8badc464250d" status: 200 len: 1678 microversion: 2.1 time: 0.167373 Dec 24 10:49:43.805128 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 378/750] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:49:43 2021] GET /compute/v2.1/servers/9330dbb8-edad-4d54-afeb-8badc464250d => generated 1678 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:49:44.247911 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-36a2acb0-ed40-4b96-bc0b-6be15d84b770 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:49:44.248800 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-36a2acb0-ed40-4b96-bc0b-6be15d84b770 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] [instance: a99a6a98-4010-4f8e-a83f-fcc490f6ece0] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:49:44.256858 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-36a2acb0-ed40-4b96-bc0b-6be15d84b770 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:49:44.257778 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-36a2acb0-ed40-4b96-bc0b-6be15d84b770 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:49:44.258712 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-36a2acb0-ed40-4b96-bc0b-6be15d84b770 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:49:44.260174 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-36a2acb0-ed40-4b96-bc0b-6be15d84b770 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:49:44.290542 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-36a2acb0-ed40-4b96-bc0b-6be15d84b770 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] 10.222.0.30 "GET /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046848 Dec 24 10:49:44.291218 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 373/751] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Dec 24 10:49:44 2021] GET /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 24 10:49:44.821687 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-17cc29bf-ca2f-453c-9675-c393a106f58f tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:49:44.822234 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-17cc29bf-ca2f-453c-9675-c393a106f58f tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] [instance: 9330dbb8-edad-4d54-afeb-8badc464250d] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:49:44.828499 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-17cc29bf-ca2f-453c-9675-c393a106f58f tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:49:44.828982 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-17cc29bf-ca2f-453c-9675-c393a106f58f tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:49:44.829803 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-17cc29bf-ca2f-453c-9675-c393a106f58f tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:49:44.830235 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-17cc29bf-ca2f-453c-9675-c393a106f58f tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:49:44.962152 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-17cc29bf-ca2f-453c-9675-c393a106f58f tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37516225f9244c969ed168f6a024482a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0115a5cc8b4b1e8bffb84e0f3e0b08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:49:44.969901 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-17cc29bf-ca2f-453c-9675-c393a106f58f tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] 10.222.0.30 "GET /compute/v2.1/servers/9330dbb8-edad-4d54-afeb-8badc464250d" status: 200 len: 1678 microversion: 2.1 time: 0.151993 Dec 24 10:49:44.970460 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 379/752] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:49:44 2021] GET /compute/v2.1/servers/9330dbb8-edad-4d54-afeb-8badc464250d => generated 1678 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:49:45.301544 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-fcb485ac-f42e-464f-8361-9749942bda9b tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:49:45.302434 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-fcb485ac-f42e-464f-8361-9749942bda9b tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] [instance: a99a6a98-4010-4f8e-a83f-fcc490f6ece0] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:49:45.309381 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-fcb485ac-f42e-464f-8361-9749942bda9b tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:49:45.312783 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-fcb485ac-f42e-464f-8361-9749942bda9b tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:49:45.312783 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-fcb485ac-f42e-464f-8361-9749942bda9b tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:49:45.312783 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-fcb485ac-f42e-464f-8361-9749942bda9b tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:49:45.340030 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-fcb485ac-f42e-464f-8361-9749942bda9b tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] 10.222.0.30 "GET /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.041945 Dec 24 10:49:45.340539 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 374/753] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Dec 24 10:49:45 2021] GET /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:49:45.400256 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-c92fcb53-b856-4ef6-b353-a0ae82a5523d tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:49:45.401192 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-c92fcb53-b856-4ef6-b353-a0ae82a5523d tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] [instance: a99a6a98-4010-4f8e-a83f-fcc490f6ece0] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:49:45.409875 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-c92fcb53-b856-4ef6-b353-a0ae82a5523d tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:49:45.410313 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-c92fcb53-b856-4ef6-b353-a0ae82a5523d tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:49:45.411095 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-c92fcb53-b856-4ef6-b353-a0ae82a5523d tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:49:45.411521 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-c92fcb53-b856-4ef6-b353-a0ae82a5523d tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:49:45.437145 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-c92fcb53-b856-4ef6-b353-a0ae82a5523d tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] [instance: a99a6a98-4010-4f8e-a83f-fcc490f6ece0] Going to try to terminate instance {{(pid=123432) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 24 10:49:45.783684 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-c92fcb53-b856-4ef6-b353-a0ae82a5523d tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] 10.222.0.30 "DELETE /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0" status: 204 len: 0 microversion: 2.20 time: 0.389770 Dec 24 10:49:45.784280 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 380/754] 10.222.0.30 () {60 vars in 1279 bytes} [Fri Dec 24 10:49:45 2021] DELETE /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Dec 24 10:49:45.793659 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-90f54c90-5eee-4f71-b50b-072783d2d3e3 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:49:45.794308 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-90f54c90-5eee-4f71-b50b-072783d2d3e3 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] [instance: a99a6a98-4010-4f8e-a83f-fcc490f6ece0] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:49:45.800691 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-90f54c90-5eee-4f71-b50b-072783d2d3e3 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:49:45.801172 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-90f54c90-5eee-4f71-b50b-072783d2d3e3 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:49:45.801933 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-90f54c90-5eee-4f71-b50b-072783d2d3e3 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:49:45.802359 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-90f54c90-5eee-4f71-b50b-072783d2d3e3 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:49:45.935047 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-90f54c90-5eee-4f71-b50b-072783d2d3e3 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:49:45.942833 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-90f54c90-5eee-4f71-b50b-072783d2d3e3 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:49:45.944342 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-90f54c90-5eee-4f71-b50b-072783d2d3e3 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:49:45.945503 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-90f54c90-5eee-4f71-b50b-072783d2d3e3 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] 10.222.0.30 "GET /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0" status: 200 len: 1723 microversion: 2.20 time: 0.156860 Dec 24 10:49:45.946086 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 375/755] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Dec 24 10:49:45 2021] GET /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0 => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 10:49:45.987259 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-0f7cad12-2d27-43a1-97cf-50f19586475e tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:49:45.987971 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-0f7cad12-2d27-43a1-97cf-50f19586475e tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] [instance: 9330dbb8-edad-4d54-afeb-8badc464250d] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:49:45.994335 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-0f7cad12-2d27-43a1-97cf-50f19586475e tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:49:45.994810 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-0f7cad12-2d27-43a1-97cf-50f19586475e tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:49:45.995733 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-0f7cad12-2d27-43a1-97cf-50f19586475e tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:49:45.996210 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-0f7cad12-2d27-43a1-97cf-50f19586475e tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:49:46.130456 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-0f7cad12-2d27-43a1-97cf-50f19586475e tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37516225f9244c969ed168f6a024482a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0115a5cc8b4b1e8bffb84e0f3e0b08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:49:46.138478 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-0f7cad12-2d27-43a1-97cf-50f19586475e tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] 10.222.0.30 "GET /compute/v2.1/servers/9330dbb8-edad-4d54-afeb-8badc464250d" status: 200 len: 1678 microversion: 2.1 time: 0.155331 Dec 24 10:49:46.139044 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 381/756] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:49:45 2021] GET /compute/v2.1/servers/9330dbb8-edad-4d54-afeb-8badc464250d => generated 1678 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:49:46.963600 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-8745e7ac-98bb-4475-a506-2de5fef225dd tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:49:46.964196 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-8745e7ac-98bb-4475-a506-2de5fef225dd tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] [instance: a99a6a98-4010-4f8e-a83f-fcc490f6ece0] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:49:46.970522 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-8745e7ac-98bb-4475-a506-2de5fef225dd tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:49:46.970959 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-8745e7ac-98bb-4475-a506-2de5fef225dd tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:49:46.974335 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-8745e7ac-98bb-4475-a506-2de5fef225dd tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:49:46.974335 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-8745e7ac-98bb-4475-a506-2de5fef225dd tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:49:47.102876 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-8745e7ac-98bb-4475-a506-2de5fef225dd tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:49:47.111908 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-8745e7ac-98bb-4475-a506-2de5fef225dd tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:49:47.113603 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-8745e7ac-98bb-4475-a506-2de5fef225dd tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:49:47.114859 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-8745e7ac-98bb-4475-a506-2de5fef225dd tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] 10.222.0.30 "GET /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0" status: 200 len: 1723 microversion: 2.20 time: 0.154908 Dec 24 10:49:47.115484 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 376/757] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Dec 24 10:49:46 2021] GET /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0 => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 10:49:47.155604 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-4a1e5b24-a542-4bf4-9325-337c68483d4e tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:49:47.156218 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-4a1e5b24-a542-4bf4-9325-337c68483d4e tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] [instance: 9330dbb8-edad-4d54-afeb-8badc464250d] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:49:47.162579 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-4a1e5b24-a542-4bf4-9325-337c68483d4e tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:49:47.163021 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-4a1e5b24-a542-4bf4-9325-337c68483d4e tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:49:47.163833 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-4a1e5b24-a542-4bf4-9325-337c68483d4e tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:49:47.164267 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-4a1e5b24-a542-4bf4-9325-337c68483d4e tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:49:47.296879 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-4a1e5b24-a542-4bf4-9325-337c68483d4e tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37516225f9244c969ed168f6a024482a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0115a5cc8b4b1e8bffb84e0f3e0b08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:49:47.304222 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-4a1e5b24-a542-4bf4-9325-337c68483d4e tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] 10.222.0.30 "GET /compute/v2.1/servers/9330dbb8-edad-4d54-afeb-8badc464250d" status: 200 len: 1678 microversion: 2.1 time: 0.152675 Dec 24 10:49:47.304788 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 382/758] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:49:47 2021] GET /compute/v2.1/servers/9330dbb8-edad-4d54-afeb-8badc464250d => generated 1678 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:49:48.135052 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-9f2dc360-68d7-4710-afca-d4f1c8da01bc tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:49:48.135670 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-9f2dc360-68d7-4710-afca-d4f1c8da01bc tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] [instance: a99a6a98-4010-4f8e-a83f-fcc490f6ece0] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:49:48.142296 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-9f2dc360-68d7-4710-afca-d4f1c8da01bc tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:49:48.142731 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-9f2dc360-68d7-4710-afca-d4f1c8da01bc tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:49:48.143492 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-9f2dc360-68d7-4710-afca-d4f1c8da01bc tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:49:48.143921 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-9f2dc360-68d7-4710-afca-d4f1c8da01bc tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:49:48.321028 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-c50643d0-cfc3-4f1b-9505-79e8ad601227 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:49:48.321633 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-c50643d0-cfc3-4f1b-9505-79e8ad601227 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] [instance: 9330dbb8-edad-4d54-afeb-8badc464250d] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:49:48.328545 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-c50643d0-cfc3-4f1b-9505-79e8ad601227 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:49:48.329058 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-c50643d0-cfc3-4f1b-9505-79e8ad601227 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:49:48.329836 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-c50643d0-cfc3-4f1b-9505-79e8ad601227 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:49:48.330262 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-c50643d0-cfc3-4f1b-9505-79e8ad601227 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:49:48.421075 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-9f2dc360-68d7-4710-afca-d4f1c8da01bc tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:49:48.431188 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-9f2dc360-68d7-4710-afca-d4f1c8da01bc tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:49:48.433829 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-9f2dc360-68d7-4710-afca-d4f1c8da01bc tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:49:48.435516 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-9f2dc360-68d7-4710-afca-d4f1c8da01bc tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] 10.222.0.30 "GET /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0" status: 200 len: 1723 microversion: 2.20 time: 0.304153 Dec 24 10:49:48.446957 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 377/759] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Dec 24 10:49:48 2021] GET /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0 => generated 1723 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 10:49:48.467808 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-c50643d0-cfc3-4f1b-9505-79e8ad601227 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37516225f9244c969ed168f6a024482a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0115a5cc8b4b1e8bffb84e0f3e0b08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:49:48.475649 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-c50643d0-cfc3-4f1b-9505-79e8ad601227 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] 10.222.0.30 "GET /compute/v2.1/servers/9330dbb8-edad-4d54-afeb-8badc464250d" status: 200 len: 1678 microversion: 2.1 time: 0.158151 Dec 24 10:49:48.476298 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 383/760] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:49:48 2021] GET /compute/v2.1/servers/9330dbb8-edad-4d54-afeb-8badc464250d => generated 1678 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:49:49.041162 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [req-8fcc4733-07d7-4c3b-93e8-0ae3717eda86 req-a524f52a-5fbe-4672-9bff-36d5d21f858f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a99a6a98-4010-4f8e-a83f-fcc490f6ece0", "name": "network-vif-deleted", "tag": "e50dfc57-62cb-4d13-9e17-f48edcdb1dcc"}]} {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:49:49.043329 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 10:49:49.043329 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: warnings.warn(msg) Dec 24 10:49:49.057985 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [req-8fcc4733-07d7-4c3b-93e8-0ae3717eda86 req-a524f52a-5fbe-4672-9bff-36d5d21f858f service nova] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:49:49.058703 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [req-8fcc4733-07d7-4c3b-93e8-0ae3717eda86 req-a524f52a-5fbe-4672-9bff-36d5d21f858f service nova] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:49:49.070128 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.compute.server_external_events [req-8fcc4733-07d7-4c3b-93e8-0ae3717eda86 req-a524f52a-5fbe-4672-9bff-36d5d21f858f service nova] Creating event network-vif-deleted:e50dfc57-62cb-4d13-9e17-f48edcdb1dcc for instance a99a6a98-4010-4f8e-a83f-fcc490f6ece0 on hv-cinder-81644 Dec 24 10:49:49.075796 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [req-8fcc4733-07d7-4c3b-93e8-0ae3717eda86 req-a524f52a-5fbe-4672-9bff-36d5d21f858f service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045285 Dec 24 10:49:49.076392 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 378/761] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Dec 24 10:49:49 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 10:49:49.454413 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-96f9ecf3-c9a8-4c35-a8d4-0456ef5534e0 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:49:49.455028 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-96f9ecf3-c9a8-4c35-a8d4-0456ef5534e0 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] [instance: a99a6a98-4010-4f8e-a83f-fcc490f6ece0] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:49:49.465736 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-96f9ecf3-c9a8-4c35-a8d4-0456ef5534e0 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:49:49.465736 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-96f9ecf3-c9a8-4c35-a8d4-0456ef5534e0 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:49:49.465736 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-96f9ecf3-c9a8-4c35-a8d4-0456ef5534e0 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:49:49.465736 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-96f9ecf3-c9a8-4c35-a8d4-0456ef5534e0 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:49:49.494598 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-71fcb2c0-7095-43b6-9691-24f4b7f3763f tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:49:49.496584 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-71fcb2c0-7095-43b6-9691-24f4b7f3763f tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] [instance: 9330dbb8-edad-4d54-afeb-8badc464250d] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:49:49.514592 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-71fcb2c0-7095-43b6-9691-24f4b7f3763f tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:49:49.515040 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-71fcb2c0-7095-43b6-9691-24f4b7f3763f tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:49:49.515898 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-71fcb2c0-7095-43b6-9691-24f4b7f3763f tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:49:49.516550 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-71fcb2c0-7095-43b6-9691-24f4b7f3763f tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:49:49.520610 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-96f9ecf3-c9a8-4c35-a8d4-0456ef5534e0 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:49:49.521116 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-96f9ecf3-c9a8-4c35-a8d4-0456ef5534e0 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:49:49.521611 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.objects.instance [None req-96f9ecf3-c9a8-4c35-a8d4-0456ef5534e0 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lazy-loading 'fault' on Instance uuid a99a6a98-4010-4f8e-a83f-fcc490f6ece0 {{(pid=123432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 24 10:49:49.567108 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-96f9ecf3-c9a8-4c35-a8d4-0456ef5534e0 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:49:49.579280 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-96f9ecf3-c9a8-4c35-a8d4-0456ef5534e0 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:49:49.581844 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-96f9ecf3-c9a8-4c35-a8d4-0456ef5534e0 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:49:49.583009 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-96f9ecf3-c9a8-4c35-a8d4-0456ef5534e0 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] 10.222.0.30 "GET /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0" status: 200 len: 1372 microversion: 2.20 time: 0.132395 Dec 24 10:49:49.583572 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 384/762] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Dec 24 10:49:49 2021] GET /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0 => generated 1372 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 10:49:49.683863 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-71fcb2c0-7095-43b6-9691-24f4b7f3763f tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37516225f9244c969ed168f6a024482a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0115a5cc8b4b1e8bffb84e0f3e0b08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:49:49.691297 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-71fcb2c0-7095-43b6-9691-24f4b7f3763f tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] 10.222.0.30 "GET /compute/v2.1/servers/9330dbb8-edad-4d54-afeb-8badc464250d" status: 200 len: 1678 microversion: 2.1 time: 0.200864 Dec 24 10:49:49.691868 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 379/763] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:49:49 2021] GET /compute/v2.1/servers/9330dbb8-edad-4d54-afeb-8badc464250d => generated 1678 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:49:50.601904 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-10e24c17-6c56-4e82-9b50-d7dff38791da tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:49:50.603129 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-10e24c17-6c56-4e82-9b50-d7dff38791da tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] [instance: a99a6a98-4010-4f8e-a83f-fcc490f6ece0] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:49:50.615262 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-10e24c17-6c56-4e82-9b50-d7dff38791da tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:49:50.618596 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-10e24c17-6c56-4e82-9b50-d7dff38791da tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:49:50.619896 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-10e24c17-6c56-4e82-9b50-d7dff38791da tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:49:50.621471 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-10e24c17-6c56-4e82-9b50-d7dff38791da tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:49:50.635011 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.wsgi [None req-10e24c17-6c56-4e82-9b50-d7dff38791da tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] HTTP exception thrown: Instance a99a6a98-4010-4f8e-a83f-fcc490f6ece0 could not be found. Dec 24 10:49:50.636180 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-10e24c17-6c56-4e82-9b50-d7dff38791da tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Returning 404 to user: Instance a99a6a98-4010-4f8e-a83f-fcc490f6ece0 could not be found. {{(pid=123432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 24 10:49:50.637096 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-10e24c17-6c56-4e82-9b50-d7dff38791da tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] 10.222.0.30 "GET /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0" status: 404 len: 111 microversion: 2.20 time: 0.039628 Dec 24 10:49:50.638046 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 385/764] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Dec 24 10:49:50 2021] GET /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Dec 24 10:49:50.646890 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-2157ec0f-0607-4cbf-a49d-910ab4e98b1b tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Calling method '.version_select at 0x7f1899a9b040>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:49:50.708977 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-9b4aa715-323b-4394-903d-f55cd24c2e9f tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:49:50.709642 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-9b4aa715-323b-4394-903d-f55cd24c2e9f tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] [instance: 9330dbb8-edad-4d54-afeb-8badc464250d] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:49:50.718520 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-9b4aa715-323b-4394-903d-f55cd24c2e9f tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:49:50.718969 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-9b4aa715-323b-4394-903d-f55cd24c2e9f tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:49:50.719797 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-9b4aa715-323b-4394-903d-f55cd24c2e9f tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:49:50.720233 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-9b4aa715-323b-4394-903d-f55cd24c2e9f tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:49:50.784228 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-2157ec0f-0607-4cbf-a49d-910ab4e98b1b tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1815752854" status: 204 len: 0 microversion: 2.20 time: 0.141679 Dec 24 10:49:50.785656 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 380/765] 10.222.0.30 () {60 vars in 1261 bytes} [Fri Dec 24 10:49:50 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1815752854 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Dec 24 10:49:50.874704 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-9b4aa715-323b-4394-903d-f55cd24c2e9f tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37516225f9244c969ed168f6a024482a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0115a5cc8b4b1e8bffb84e0f3e0b08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:49:50.887931 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-9b4aa715-323b-4394-903d-f55cd24c2e9f tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] 10.222.0.30 "GET /compute/v2.1/servers/9330dbb8-edad-4d54-afeb-8badc464250d" status: 200 len: 1678 microversion: 2.1 time: 0.183127 Dec 24 10:49:50.892167 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 386/766] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:49:50 2021] GET /compute/v2.1/servers/9330dbb8-edad-4d54-afeb-8badc464250d => generated 1678 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:49:51.876015 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-4ec94469-c257-4b4f-a6cf-59b17c399604 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Action: 'create', calling method: .version_select at 0x7f1899ac5af0>, body: {"keypair": {"name": "tempest-keypair-161970771"}} {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:49:51.892349 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.quota [None req-4ec94469-c257-4b4f-a6cf-59b17c399604 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Getting quotas for project 8b52b70f10024974af39a32f1a1a2502. Resources: {'key_pairs'} {{(pid=123431) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 24 10:49:51.897311 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.quota [None req-4ec94469-c257-4b4f-a6cf-59b17c399604 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Getting quotas for user e695a7efa1c1465b99a8fb0b434a59f2 and project 8b52b70f10024974af39a32f1a1a2502. Resources: {'key_pairs'} {{(pid=123431) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 24 10:49:51.905875 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-73cc8834-79a0-4142-9873-00736d68cbf2 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:49:51.907759 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-73cc8834-79a0-4142-9873-00736d68cbf2 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] [instance: 9330dbb8-edad-4d54-afeb-8badc464250d] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:49:51.915906 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-73cc8834-79a0-4142-9873-00736d68cbf2 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:49:51.916353 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-73cc8834-79a0-4142-9873-00736d68cbf2 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:49:51.919464 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-73cc8834-79a0-4142-9873-00736d68cbf2 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:49:51.919919 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-73cc8834-79a0-4142-9873-00736d68cbf2 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:49:52.088556 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-73cc8834-79a0-4142-9873-00736d68cbf2 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37516225f9244c969ed168f6a024482a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0115a5cc8b4b1e8bffb84e0f3e0b08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:49:52.096242 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-73cc8834-79a0-4142-9873-00736d68cbf2 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] 10.222.0.30 "GET /compute/v2.1/servers/9330dbb8-edad-4d54-afeb-8badc464250d" status: 200 len: 1655 microversion: 2.1 time: 0.194034 Dec 24 10:49:52.096905 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 387/767] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:49:51 2021] GET /compute/v2.1/servers/9330dbb8-edad-4d54-afeb-8badc464250d => generated 1655 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 24 10:49:52.113108 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-7730ae03-d66c-4c2d-854d-7597f814379b tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:49:52.118987 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-7730ae03-d66c-4c2d-854d-7597f814379b tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:49:52.120689 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-7730ae03-d66c-4c2d-854d-7597f814379b tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:49:52.141256 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-7730ae03-d66c-4c2d-854d-7597f814379b tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] [instance: 9330dbb8-edad-4d54-afeb-8badc464250d] Going to try to start instance {{(pid=123432) start /opt/stack/nova/nova/compute/api.py:2677}} Dec 24 10:49:52.392206 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-7730ae03-d66c-4c2d-854d-7597f814379b tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] 10.222.0.30 "POST /compute/v2.1/servers/9330dbb8-edad-4d54-afeb-8badc464250d/action" status: 202 len: 0 microversion: 2.1 time: 0.282337 Dec 24 10:49:52.392604 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 388/768] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Dec 24 10:49:52 2021] POST /compute/v2.1/servers/9330dbb8-edad-4d54-afeb-8badc464250d/action => generated 0 bytes in 284 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Dec 24 10:49:52.402816 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-b2774220-68ff-4fc3-82f3-3f9cb9e453c4 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:49:52.403523 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-b2774220-68ff-4fc3-82f3-3f9cb9e453c4 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] [instance: 9330dbb8-edad-4d54-afeb-8badc464250d] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:49:52.409764 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-b2774220-68ff-4fc3-82f3-3f9cb9e453c4 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:49:52.410494 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-b2774220-68ff-4fc3-82f3-3f9cb9e453c4 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:49:52.411550 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-b2774220-68ff-4fc3-82f3-3f9cb9e453c4 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:49:52.412241 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-b2774220-68ff-4fc3-82f3-3f9cb9e453c4 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:49:52.465369 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.quota [None req-4ec94469-c257-4b4f-a6cf-59b17c399604 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Getting quotas for project 8b52b70f10024974af39a32f1a1a2502. Resources: {'key_pairs'} {{(pid=123431) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 24 10:49:52.469653 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.quota [None req-4ec94469-c257-4b4f-a6cf-59b17c399604 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Getting quotas for user e695a7efa1c1465b99a8fb0b434a59f2 and project 8b52b70f10024974af39a32f1a1a2502. Resources: {'key_pairs'} {{(pid=123431) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 24 10:49:52.486491 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-4ec94469-c257-4b4f-a6cf-59b17c399604 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 201 len: 2315 microversion: 2.20 time: 0.614257 Dec 24 10:49:52.487847 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 381/769] 10.222.0.30 () {62 vars in 1198 bytes} [Fri Dec 24 10:49:51 2021] POST /compute/v2.1/os-keypairs => generated 2315 bytes in 616 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Dec 24 10:49:52.604433 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-b2774220-68ff-4fc3-82f3-3f9cb9e453c4 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37516225f9244c969ed168f6a024482a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0115a5cc8b4b1e8bffb84e0f3e0b08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:49:52.621011 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-b2774220-68ff-4fc3-82f3-3f9cb9e453c4 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] 10.222.0.30 "GET /compute/v2.1/servers/9330dbb8-edad-4d54-afeb-8badc464250d" status: 200 len: 1664 microversion: 2.1 time: 0.223226 Dec 24 10:49:52.621590 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 389/770] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:49:52 2021] GET /compute/v2.1/servers/9330dbb8-edad-4d54-afeb-8badc464250d => generated 1664 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 24 10:49:53.639276 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-4c66c02c-1333-41d1-8331-c3bf674d89a0 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:49:53.640388 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-4c66c02c-1333-41d1-8331-c3bf674d89a0 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] [instance: 9330dbb8-edad-4d54-afeb-8badc464250d] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:49:53.647637 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-4c66c02c-1333-41d1-8331-c3bf674d89a0 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:49:53.648172 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-4c66c02c-1333-41d1-8331-c3bf674d89a0 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:49:53.649068 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-4c66c02c-1333-41d1-8331-c3bf674d89a0 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:49:53.649598 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-4c66c02c-1333-41d1-8331-c3bf674d89a0 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:49:53.789570 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-4c66c02c-1333-41d1-8331-c3bf674d89a0 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37516225f9244c969ed168f6a024482a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0115a5cc8b4b1e8bffb84e0f3e0b08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:49:53.797296 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-4c66c02c-1333-41d1-8331-c3bf674d89a0 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] 10.222.0.30 "GET /compute/v2.1/servers/9330dbb8-edad-4d54-afeb-8badc464250d" status: 200 len: 1664 microversion: 2.1 time: 0.162744 Dec 24 10:49:53.797864 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 382/771] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:49:53 2021] GET /compute/v2.1/servers/9330dbb8-edad-4d54-afeb-8badc464250d => generated 1664 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:49:54.814208 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-2b1b7dae-e510-44e4-a72a-ab45fb5dc922 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:49:54.814814 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-2b1b7dae-e510-44e4-a72a-ab45fb5dc922 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] [instance: 9330dbb8-edad-4d54-afeb-8badc464250d] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:49:54.821086 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-2b1b7dae-e510-44e4-a72a-ab45fb5dc922 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:49:54.821575 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-2b1b7dae-e510-44e4-a72a-ab45fb5dc922 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:49:54.822326 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-2b1b7dae-e510-44e4-a72a-ab45fb5dc922 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:49:54.822759 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-2b1b7dae-e510-44e4-a72a-ab45fb5dc922 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:49:55.026271 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-2b1b7dae-e510-44e4-a72a-ab45fb5dc922 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37516225f9244c969ed168f6a024482a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0115a5cc8b4b1e8bffb84e0f3e0b08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:49:55.033849 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-2b1b7dae-e510-44e4-a72a-ab45fb5dc922 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] 10.222.0.30 "GET /compute/v2.1/servers/9330dbb8-edad-4d54-afeb-8badc464250d" status: 200 len: 1668 microversion: 2.1 time: 0.223285 Dec 24 10:49:55.034424 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 390/772] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:49:54 2021] GET /compute/v2.1/servers/9330dbb8-edad-4d54-afeb-8badc464250d => generated 1668 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:49:55.533046 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-fa6057fb-11aa-4588-866d-fba1711d013c tempest-VolumesNegativeTest-1999238818 tempest-VolumesNegativeTest-1999238818-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-301294479", "imageRef": "fae8172d-77c4-4f40-905a-7285c185448c", "flavorRef": "452"}} {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:49:55.584452 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.network.neutron [None req-fa6057fb-11aa-4588-866d-fba1711d013c tempest-VolumesNegativeTest-1999238818 tempest-VolumesNegativeTest-1999238818-project] validate_networks() for None {{(pid=123431) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 24 10:49:55.683670 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-7053e570-0930-45df-8299-d8b1144f33dd tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1314626032", "imageRef": "fae8172d-77c4-4f40-905a-7285c185448c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c0b8ee9e-b93e-467f-bfaf-ed33e3a53f71"}], "security_groups": [{"name": "tempest-securitygroup--1335848506"}], "key_name": "tempest-keypair-161970771", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:49:55.784184 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.network.neutron [None req-7053e570-0930-45df-8299-d8b1144f33dd tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] validate_networks() for [('c0b8ee9e-b93e-467f-bfaf-ed33e3a53f71', None, None, None, None, None)] {{(pid=123432) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 24 10:49:55.870820 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.virt.hardware [None req-fa6057fb-11aa-4588-866d-fba1711d013c tempest-VolumesNegativeTest-1999238818 tempest-VolumesNegativeTest-1999238818-project] Flavor limits 0:0:0 {{(pid=123431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 24 10:49:55.871246 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.virt.hardware [None req-fa6057fb-11aa-4588-866d-fba1711d013c tempest-VolumesNegativeTest-1999238818 tempest-VolumesNegativeTest-1999238818-project] Image limits 0:0:0 {{(pid=123431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 24 10:49:55.871777 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.virt.hardware [None req-fa6057fb-11aa-4588-866d-fba1711d013c tempest-VolumesNegativeTest-1999238818 tempest-VolumesNegativeTest-1999238818-project] Flavor pref 0:0:0 {{(pid=123431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 24 10:49:55.872331 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.virt.hardware [None req-fa6057fb-11aa-4588-866d-fba1711d013c tempest-VolumesNegativeTest-1999238818 tempest-VolumesNegativeTest-1999238818-project] Image pref 0:0:0 {{(pid=123431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 24 10:49:55.872747 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.virt.hardware [None req-fa6057fb-11aa-4588-866d-fba1711d013c tempest-VolumesNegativeTest-1999238818 tempest-VolumesNegativeTest-1999238818-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 24 10:49:55.881572 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-fa6057fb-11aa-4588-866d-fba1711d013c tempest-VolumesNegativeTest-1999238818 tempest-VolumesNegativeTest-1999238818-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:49:55.882020 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-fa6057fb-11aa-4588-866d-fba1711d013c tempest-VolumesNegativeTest-1999238818 tempest-VolumesNegativeTest-1999238818-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:49:55.882828 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-fa6057fb-11aa-4588-866d-fba1711d013c tempest-VolumesNegativeTest-1999238818 tempest-VolumesNegativeTest-1999238818-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:49:55.883260 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-fa6057fb-11aa-4588-866d-fba1711d013c tempest-VolumesNegativeTest-1999238818 tempest-VolumesNegativeTest-1999238818-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:49:55.901710 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.quota [None req-fa6057fb-11aa-4588-866d-fba1711d013c tempest-VolumesNegativeTest-1999238818 tempest-VolumesNegativeTest-1999238818-project] Getting quotas for project 3f6eb4208cd44353b71f263b6ec1aaa6. Resources: {'instances', 'cores', 'ram'} {{(pid=123431) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 24 10:49:55.905664 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.quota [None req-fa6057fb-11aa-4588-866d-fba1711d013c tempest-VolumesNegativeTest-1999238818 tempest-VolumesNegativeTest-1999238818-project] Getting quotas for user 1388ed800fab47adbe500bc0fa3265a4 and project 3f6eb4208cd44353b71f263b6ec1aaa6. Resources: {'instances', 'cores', 'ram'} {{(pid=123431) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 24 10:49:55.916434 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-fa6057fb-11aa-4588-866d-fba1711d013c tempest-VolumesNegativeTest-1999238818 tempest-VolumesNegativeTest-1999238818-project] Going to run 1 instances... {{(pid=123431) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 24 10:49:55.919300 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-fa6057fb-11aa-4588-866d-fba1711d013c tempest-VolumesNegativeTest-1999238818 tempest-VolumesNegativeTest-1999238818-project] [instance: 4652b76e-2f6a-459c-a8f8-0d7badb48e4b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fae8172d-77c4-4f40-905a-7285c185448c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123431) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 24 10:49:56.073676 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-fa6057fb-11aa-4588-866d-fba1711d013c tempest-VolumesNegativeTest-1999238818 tempest-VolumesNegativeTest-1999238818-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.543579 Dec 24 10:49:56.074516 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 383/773] 10.222.0.30 () {60 vars in 1146 bytes} [Fri Dec 24 10:49:55 2021] POST /compute/v2.1/servers => generated 380 bytes in 546 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 24 10:49:56.085075 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-168174ea-7904-4717-ba44-f9a447a361da tempest-VolumesNegativeTest-1999238818 tempest-VolumesNegativeTest-1999238818-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:49:56.085796 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-168174ea-7904-4717-ba44-f9a447a361da tempest-VolumesNegativeTest-1999238818 tempest-VolumesNegativeTest-1999238818-project] [instance: 4652b76e-2f6a-459c-a8f8-0d7badb48e4b] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:49:56.157846 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-168174ea-7904-4717-ba44-f9a447a361da tempest-VolumesNegativeTest-1999238818 tempest-VolumesNegativeTest-1999238818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1388ed800fab47adbe500bc0fa3265a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f6eb4208cd44353b71f263b6ec1aaa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:49:56.166843 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-168174ea-7904-4717-ba44-f9a447a361da tempest-VolumesNegativeTest-1999238818 tempest-VolumesNegativeTest-1999238818-project] 10.222.0.30 "GET /compute/v2.1/servers/4652b76e-2f6a-459c-a8f8-0d7badb48e4b" status: 200 len: 1214 microversion: 2.1 time: 0.085943 Dec 24 10:49:56.176155 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 384/774] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:49:56 2021] GET /compute/v2.1/servers/4652b76e-2f6a-459c-a8f8-0d7badb48e4b => generated 1214 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 24 10:49:56.182090 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.virt.hardware [None req-7053e570-0930-45df-8299-d8b1144f33dd tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Flavor limits 0:0:0 {{(pid=123432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 24 10:49:56.183062 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.virt.hardware [None req-7053e570-0930-45df-8299-d8b1144f33dd tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Image limits 0:0:0 {{(pid=123432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 24 10:49:56.183513 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.virt.hardware [None req-7053e570-0930-45df-8299-d8b1144f33dd tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Flavor pref 0:0:0 {{(pid=123432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 24 10:49:56.184139 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.virt.hardware [None req-7053e570-0930-45df-8299-d8b1144f33dd tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Image pref 0:0:0 {{(pid=123432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 24 10:49:56.184619 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.virt.hardware [None req-7053e570-0930-45df-8299-d8b1144f33dd tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 24 10:49:56.193455 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-7053e570-0930-45df-8299-d8b1144f33dd tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:49:56.194007 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-7053e570-0930-45df-8299-d8b1144f33dd tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:49:56.195002 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-7053e570-0930-45df-8299-d8b1144f33dd tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:49:56.195547 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-7053e570-0930-45df-8299-d8b1144f33dd tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:49:56.212310 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.quota [None req-7053e570-0930-45df-8299-d8b1144f33dd tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Getting quotas for project 8b52b70f10024974af39a32f1a1a2502. Resources: {'instances', 'cores', 'ram'} {{(pid=123432) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 24 10:49:56.216306 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.quota [None req-7053e570-0930-45df-8299-d8b1144f33dd tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Getting quotas for user e695a7efa1c1465b99a8fb0b434a59f2 and project 8b52b70f10024974af39a32f1a1a2502. Resources: {'instances', 'cores', 'ram'} {{(pid=123432) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 24 10:49:56.227361 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-7053e570-0930-45df-8299-d8b1144f33dd tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Going to run 1 instances... {{(pid=123432) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 24 10:49:56.229769 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-7053e570-0930-45df-8299-d8b1144f33dd tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] [instance: d2c0f276-f763-4337-a5dd-0c328c8c2e73] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fae8172d-77c4-4f40-905a-7285c185448c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123432) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 24 10:49:56.413242 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-7053e570-0930-45df-8299-d8b1144f33dd tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.734140 Dec 24 10:49:56.413879 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 391/775] 10.222.0.30 () {62 vars in 1187 bytes} [Fri Dec 24 10:49:55 2021] POST /compute/v2.1/servers => generated 402 bytes in 735 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Dec 24 10:49:56.424164 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-19fb52a5-c37d-4f26-adcc-bcf79802dee4 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:49:56.424769 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-19fb52a5-c37d-4f26-adcc-bcf79802dee4 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] [instance: d2c0f276-f763-4337-a5dd-0c328c8c2e73] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:49:56.478859 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-19fb52a5-c37d-4f26-adcc-bcf79802dee4 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:49:56.486565 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-19fb52a5-c37d-4f26-adcc-bcf79802dee4 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:49:56.488320 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-19fb52a5-c37d-4f26-adcc-bcf79802dee4 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:49:56.489408 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-19fb52a5-c37d-4f26-adcc-bcf79802dee4 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] 10.222.0.30 "GET /compute/v2.1/servers/d2c0f276-f763-4337-a5dd-0c328c8c2e73" status: 200 len: 1281 microversion: 2.20 time: 0.068988 Dec 24 10:49:56.489978 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 385/776] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Dec 24 10:49:56 2021] GET /compute/v2.1/servers/d2c0f276-f763-4337-a5dd-0c328c8c2e73 => generated 1281 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 24 10:49:57.184312 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-7aeffeb7-ea42-4153-99de-785157ad38b6 tempest-VolumesNegativeTest-1999238818 tempest-VolumesNegativeTest-1999238818-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:49:57.185092 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-7aeffeb7-ea42-4153-99de-785157ad38b6 tempest-VolumesNegativeTest-1999238818 tempest-VolumesNegativeTest-1999238818-project] [instance: 4652b76e-2f6a-459c-a8f8-0d7badb48e4b] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:49:57.238285 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-7aeffeb7-ea42-4153-99de-785157ad38b6 tempest-VolumesNegativeTest-1999238818 tempest-VolumesNegativeTest-1999238818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1388ed800fab47adbe500bc0fa3265a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f6eb4208cd44353b71f263b6ec1aaa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:49:57.246538 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-7aeffeb7-ea42-4153-99de-785157ad38b6 tempest-VolumesNegativeTest-1999238818 tempest-VolumesNegativeTest-1999238818-project] 10.222.0.30 "GET /compute/v2.1/servers/4652b76e-2f6a-459c-a8f8-0d7badb48e4b" status: 200 len: 1214 microversion: 2.1 time: 0.066932 Dec 24 10:49:57.249885 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 392/777] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:49:57 2021] GET /compute/v2.1/servers/4652b76e-2f6a-459c-a8f8-0d7badb48e4b => generated 1214 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:49:57.507602 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-60e873ca-1d83-4b32-bc18-9b6871c53079 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:49:57.508259 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-60e873ca-1d83-4b32-bc18-9b6871c53079 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] [instance: d2c0f276-f763-4337-a5dd-0c328c8c2e73] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:49:57.516224 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-60e873ca-1d83-4b32-bc18-9b6871c53079 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:49:57.517010 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-60e873ca-1d83-4b32-bc18-9b6871c53079 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:49:57.518203 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-60e873ca-1d83-4b32-bc18-9b6871c53079 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:49:57.523780 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-60e873ca-1d83-4b32-bc18-9b6871c53079 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:49:57.577120 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-60e873ca-1d83-4b32-bc18-9b6871c53079 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:49:57.584597 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-60e873ca-1d83-4b32-bc18-9b6871c53079 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:49:57.586156 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-60e873ca-1d83-4b32-bc18-9b6871c53079 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:49:57.590146 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-60e873ca-1d83-4b32-bc18-9b6871c53079 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] 10.222.0.30 "GET /compute/v2.1/servers/d2c0f276-f763-4337-a5dd-0c328c8c2e73" status: 200 len: 1285 microversion: 2.20 time: 0.086580 Dec 24 10:49:57.590728 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 386/778] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Dec 24 10:49:57 2021] GET /compute/v2.1/servers/d2c0f276-f763-4337-a5dd-0c328c8c2e73 => generated 1285 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 10:49:58.263122 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-f3a52012-f92a-45d9-b6c1-f7b3d0e973a6 tempest-VolumesNegativeTest-1999238818 tempest-VolumesNegativeTest-1999238818-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:49:58.263723 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-f3a52012-f92a-45d9-b6c1-f7b3d0e973a6 tempest-VolumesNegativeTest-1999238818 tempest-VolumesNegativeTest-1999238818-project] [instance: 4652b76e-2f6a-459c-a8f8-0d7badb48e4b] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:49:58.270908 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-f3a52012-f92a-45d9-b6c1-f7b3d0e973a6 tempest-VolumesNegativeTest-1999238818 tempest-VolumesNegativeTest-1999238818-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:49:58.271353 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-f3a52012-f92a-45d9-b6c1-f7b3d0e973a6 tempest-VolumesNegativeTest-1999238818 tempest-VolumesNegativeTest-1999238818-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:49:58.272124 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-f3a52012-f92a-45d9-b6c1-f7b3d0e973a6 tempest-VolumesNegativeTest-1999238818 tempest-VolumesNegativeTest-1999238818-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:49:58.272551 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-f3a52012-f92a-45d9-b6c1-f7b3d0e973a6 tempest-VolumesNegativeTest-1999238818 tempest-VolumesNegativeTest-1999238818-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:49:58.330486 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-f3a52012-f92a-45d9-b6c1-f7b3d0e973a6 tempest-VolumesNegativeTest-1999238818 tempest-VolumesNegativeTest-1999238818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1388ed800fab47adbe500bc0fa3265a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f6eb4208cd44353b71f263b6ec1aaa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:49:58.338153 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-f3a52012-f92a-45d9-b6c1-f7b3d0e973a6 tempest-VolumesNegativeTest-1999238818 tempest-VolumesNegativeTest-1999238818-project] 10.222.0.30 "GET /compute/v2.1/servers/4652b76e-2f6a-459c-a8f8-0d7badb48e4b" status: 200 len: 1266 microversion: 2.1 time: 0.079126 Dec 24 10:49:58.338714 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 393/779] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:49:58 2021] GET /compute/v2.1/servers/4652b76e-2f6a-459c-a8f8-0d7badb48e4b => generated 1266 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:49:58.607532 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-bbff5027-eb5e-4979-9395-c0f3dea82a53 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:49:58.608626 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-bbff5027-eb5e-4979-9395-c0f3dea82a53 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] [instance: d2c0f276-f763-4337-a5dd-0c328c8c2e73] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:49:58.614559 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-bbff5027-eb5e-4979-9395-c0f3dea82a53 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:49:58.615000 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-bbff5027-eb5e-4979-9395-c0f3dea82a53 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:49:58.615773 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-bbff5027-eb5e-4979-9395-c0f3dea82a53 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:49:58.616199 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-bbff5027-eb5e-4979-9395-c0f3dea82a53 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:49:58.675641 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-bbff5027-eb5e-4979-9395-c0f3dea82a53 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:49:58.683849 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-bbff5027-eb5e-4979-9395-c0f3dea82a53 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:49:58.685361 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-bbff5027-eb5e-4979-9395-c0f3dea82a53 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:49:58.686435 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-bbff5027-eb5e-4979-9395-c0f3dea82a53 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] 10.222.0.30 "GET /compute/v2.1/servers/d2c0f276-f763-4337-a5dd-0c328c8c2e73" status: 200 len: 1277 microversion: 2.20 time: 0.082699 Dec 24 10:49:58.686991 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 387/780] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Dec 24 10:49:58 2021] GET /compute/v2.1/servers/d2c0f276-f763-4337-a5dd-0c328c8c2e73 => generated 1277 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 24 10:49:59.355253 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-afac7d0d-8426-480e-9516-e8ff1adbb2a6 tempest-VolumesNegativeTest-1999238818 tempest-VolumesNegativeTest-1999238818-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:49:59.356051 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-afac7d0d-8426-480e-9516-e8ff1adbb2a6 tempest-VolumesNegativeTest-1999238818 tempest-VolumesNegativeTest-1999238818-project] [instance: 4652b76e-2f6a-459c-a8f8-0d7badb48e4b] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:49:59.362541 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-afac7d0d-8426-480e-9516-e8ff1adbb2a6 tempest-VolumesNegativeTest-1999238818 tempest-VolumesNegativeTest-1999238818-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:49:59.362985 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-afac7d0d-8426-480e-9516-e8ff1adbb2a6 tempest-VolumesNegativeTest-1999238818 tempest-VolumesNegativeTest-1999238818-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:49:59.363766 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-afac7d0d-8426-480e-9516-e8ff1adbb2a6 tempest-VolumesNegativeTest-1999238818 tempest-VolumesNegativeTest-1999238818-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:49:59.364195 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-afac7d0d-8426-480e-9516-e8ff1adbb2a6 tempest-VolumesNegativeTest-1999238818 tempest-VolumesNegativeTest-1999238818-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:49:59.423425 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-afac7d0d-8426-480e-9516-e8ff1adbb2a6 tempest-VolumesNegativeTest-1999238818 tempest-VolumesNegativeTest-1999238818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1388ed800fab47adbe500bc0fa3265a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f6eb4208cd44353b71f263b6ec1aaa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:49:59.430741 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-afac7d0d-8426-480e-9516-e8ff1adbb2a6 tempest-VolumesNegativeTest-1999238818 tempest-VolumesNegativeTest-1999238818-project] 10.222.0.30 "GET /compute/v2.1/servers/4652b76e-2f6a-459c-a8f8-0d7badb48e4b" status: 200 len: 1272 microversion: 2.1 time: 0.079737 Dec 24 10:49:59.440210 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 394/781] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:49:59 2021] GET /compute/v2.1/servers/4652b76e-2f6a-459c-a8f8-0d7badb48e4b => generated 1272 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:49:59.703628 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-cf886e9f-99e1-43e9-90ef-8cd6d74bb4cf tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:49:59.704422 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-cf886e9f-99e1-43e9-90ef-8cd6d74bb4cf tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] [instance: d2c0f276-f763-4337-a5dd-0c328c8c2e73] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:49:59.711767 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-cf886e9f-99e1-43e9-90ef-8cd6d74bb4cf tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:49:59.712654 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-cf886e9f-99e1-43e9-90ef-8cd6d74bb4cf tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:49:59.713573 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-cf886e9f-99e1-43e9-90ef-8cd6d74bb4cf tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:49:59.714247 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-cf886e9f-99e1-43e9-90ef-8cd6d74bb4cf tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:49:59.944677 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-cf886e9f-99e1-43e9-90ef-8cd6d74bb4cf tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:49:59.954078 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-cf886e9f-99e1-43e9-90ef-8cd6d74bb4cf tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:49:59.955578 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-cf886e9f-99e1-43e9-90ef-8cd6d74bb4cf tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:49:59.956733 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-cf886e9f-99e1-43e9-90ef-8cd6d74bb4cf tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] 10.222.0.30 "GET /compute/v2.1/servers/d2c0f276-f763-4337-a5dd-0c328c8c2e73" status: 200 len: 1341 microversion: 2.20 time: 0.257050 Dec 24 10:49:59.957522 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 388/782] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Dec 24 10:49:59 2021] GET /compute/v2.1/servers/d2c0f276-f763-4337-a5dd-0c328c8c2e73 => generated 1341 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 10:50:00.446817 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-8eacdfff-af2d-4de9-8f10-e0b06d3ebf17 tempest-VolumesNegativeTest-1999238818 tempest-VolumesNegativeTest-1999238818-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:50:00.455838 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-8eacdfff-af2d-4de9-8f10-e0b06d3ebf17 tempest-VolumesNegativeTest-1999238818 tempest-VolumesNegativeTest-1999238818-project] [instance: 4652b76e-2f6a-459c-a8f8-0d7badb48e4b] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:50:00.455838 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-8eacdfff-af2d-4de9-8f10-e0b06d3ebf17 tempest-VolumesNegativeTest-1999238818 tempest-VolumesNegativeTest-1999238818-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:50:00.455838 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-8eacdfff-af2d-4de9-8f10-e0b06d3ebf17 tempest-VolumesNegativeTest-1999238818 tempest-VolumesNegativeTest-1999238818-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:50:00.455838 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-8eacdfff-af2d-4de9-8f10-e0b06d3ebf17 tempest-VolumesNegativeTest-1999238818 tempest-VolumesNegativeTest-1999238818-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:50:00.456252 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-8eacdfff-af2d-4de9-8f10-e0b06d3ebf17 tempest-VolumesNegativeTest-1999238818 tempest-VolumesNegativeTest-1999238818-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:50:00.934118 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-8eacdfff-af2d-4de9-8f10-e0b06d3ebf17 tempest-VolumesNegativeTest-1999238818 tempest-VolumesNegativeTest-1999238818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1388ed800fab47adbe500bc0fa3265a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f6eb4208cd44353b71f263b6ec1aaa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:50:00.943152 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-8eacdfff-af2d-4de9-8f10-e0b06d3ebf17 tempest-VolumesNegativeTest-1999238818 tempest-VolumesNegativeTest-1999238818-project] 10.222.0.30 "GET /compute/v2.1/servers/4652b76e-2f6a-459c-a8f8-0d7badb48e4b" status: 200 len: 1314 microversion: 2.1 time: 0.500082 Dec 24 10:50:00.944318 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 395/783] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:50:00 2021] GET /compute/v2.1/servers/4652b76e-2f6a-459c-a8f8-0d7badb48e4b => generated 1314 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:50:00.982092 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-1b75cc9d-9733-4d30-acb0-f3b0f1861754 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:50:00.983488 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-1b75cc9d-9733-4d30-acb0-f3b0f1861754 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] [instance: d2c0f276-f763-4337-a5dd-0c328c8c2e73] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:50:00.996336 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-1b75cc9d-9733-4d30-acb0-f3b0f1861754 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:50:00.996336 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-1b75cc9d-9733-4d30-acb0-f3b0f1861754 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:50:00.996336 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-1b75cc9d-9733-4d30-acb0-f3b0f1861754 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:50:00.996336 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-1b75cc9d-9733-4d30-acb0-f3b0f1861754 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:50:01.204370 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-1b75cc9d-9733-4d30-acb0-f3b0f1861754 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:50:01.213008 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-1b75cc9d-9733-4d30-acb0-f3b0f1861754 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:50:01.214552 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-1b75cc9d-9733-4d30-acb0-f3b0f1861754 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:50:01.215871 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-1b75cc9d-9733-4d30-acb0-f3b0f1861754 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] 10.222.0.30 "GET /compute/v2.1/servers/d2c0f276-f763-4337-a5dd-0c328c8c2e73" status: 200 len: 1407 microversion: 2.20 time: 0.242175 Dec 24 10:50:01.217496 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 389/784] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Dec 24 10:50:00 2021] GET /compute/v2.1/servers/d2c0f276-f763-4337-a5dd-0c328c8c2e73 => generated 1407 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 24 10:50:01.404732 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [req-63b061c7-a5d0-4263-bbc1-0b4ed47a8d77 req-f6232dfd-60ac-473b-8774-a87b1c71224d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4652b76e-2f6a-459c-a8f8-0d7badb48e4b", "tag": "58497630-c432-4354-b00e-fcc9f4b8b268"}]} {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:50:01.408562 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 10:50:01.408562 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: warnings.warn(msg) Dec 24 10:50:01.418457 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [req-63b061c7-a5d0-4263-bbc1-0b4ed47a8d77 req-f6232dfd-60ac-473b-8774-a87b1c71224d service nova] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:50:01.418720 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [req-63b061c7-a5d0-4263-bbc1-0b4ed47a8d77 req-f6232dfd-60ac-473b-8774-a87b1c71224d service nova] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:50:01.430855 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.compute.server_external_events [req-63b061c7-a5d0-4263-bbc1-0b4ed47a8d77 req-f6232dfd-60ac-473b-8774-a87b1c71224d service nova] Creating event network-changed:58497630-c432-4354-b00e-fcc9f4b8b268 for instance 4652b76e-2f6a-459c-a8f8-0d7badb48e4b on hv-cinder-81644 Dec 24 10:50:01.441525 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [req-63b061c7-a5d0-4263-bbc1-0b4ed47a8d77 req-f6232dfd-60ac-473b-8774-a87b1c71224d service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050866 Dec 24 10:50:01.442444 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 396/785] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Dec 24 10:50:01 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 10:50:01.803456 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [req-989aee82-25d9-4d0b-91e2-df5e3c545b4b req-d386371d-9dda-4fc7-bdfc-e408cca61f6b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d2c0f276-f763-4337-a5dd-0c328c8c2e73", "tag": "4043d4f5-4811-4ba4-8723-4f04e5548d1c"}]} {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:50:01.805123 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 10:50:01.805123 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: warnings.warn(msg) Dec 24 10:50:01.812559 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [req-989aee82-25d9-4d0b-91e2-df5e3c545b4b req-d386371d-9dda-4fc7-bdfc-e408cca61f6b service nova] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:50:01.817655 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [req-989aee82-25d9-4d0b-91e2-df5e3c545b4b req-d386371d-9dda-4fc7-bdfc-e408cca61f6b service nova] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:50:01.838048 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.compute.server_external_events [req-989aee82-25d9-4d0b-91e2-df5e3c545b4b req-d386371d-9dda-4fc7-bdfc-e408cca61f6b service nova] Creating event network-changed:4043d4f5-4811-4ba4-8723-4f04e5548d1c for instance d2c0f276-f763-4337-a5dd-0c328c8c2e73 on hv-cinder-81644 Dec 24 10:50:01.845328 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [req-989aee82-25d9-4d0b-91e2-df5e3c545b4b req-d386371d-9dda-4fc7-bdfc-e408cca61f6b service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045683 Dec 24 10:50:01.846461 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 390/786] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Dec 24 10:50:01 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 10:50:01.960961 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-b32cf082-267c-4ebf-aafa-804c4cda5abe tempest-VolumesNegativeTest-1999238818 tempest-VolumesNegativeTest-1999238818-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:50:01.963687 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-b32cf082-267c-4ebf-aafa-804c4cda5abe tempest-VolumesNegativeTest-1999238818 tempest-VolumesNegativeTest-1999238818-project] [instance: 4652b76e-2f6a-459c-a8f8-0d7badb48e4b] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:50:01.972457 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-b32cf082-267c-4ebf-aafa-804c4cda5abe tempest-VolumesNegativeTest-1999238818 tempest-VolumesNegativeTest-1999238818-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:50:01.972958 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-b32cf082-267c-4ebf-aafa-804c4cda5abe tempest-VolumesNegativeTest-1999238818 tempest-VolumesNegativeTest-1999238818-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:50:01.974109 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-b32cf082-267c-4ebf-aafa-804c4cda5abe tempest-VolumesNegativeTest-1999238818 tempest-VolumesNegativeTest-1999238818-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:50:01.974545 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-b32cf082-267c-4ebf-aafa-804c4cda5abe tempest-VolumesNegativeTest-1999238818 tempest-VolumesNegativeTest-1999238818-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:50:02.193633 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-b32cf082-267c-4ebf-aafa-804c4cda5abe tempest-VolumesNegativeTest-1999238818 tempest-VolumesNegativeTest-1999238818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1388ed800fab47adbe500bc0fa3265a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f6eb4208cd44353b71f263b6ec1aaa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:50:02.201695 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-b32cf082-267c-4ebf-aafa-804c4cda5abe tempest-VolumesNegativeTest-1999238818 tempest-VolumesNegativeTest-1999238818-project] 10.222.0.30 "GET /compute/v2.1/servers/4652b76e-2f6a-459c-a8f8-0d7badb48e4b" status: 200 len: 1314 microversion: 2.1 time: 0.245527 Dec 24 10:50:02.202394 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 397/787] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:50:01 2021] GET /compute/v2.1/servers/4652b76e-2f6a-459c-a8f8-0d7badb48e4b => generated 1314 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:50:02.235383 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-d39dc31a-9dec-4f53-a16f-e7a4dc02f818 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:50:02.236112 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-d39dc31a-9dec-4f53-a16f-e7a4dc02f818 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] [instance: d2c0f276-f763-4337-a5dd-0c328c8c2e73] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:50:02.242185 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-d39dc31a-9dec-4f53-a16f-e7a4dc02f818 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:50:02.242634 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-d39dc31a-9dec-4f53-a16f-e7a4dc02f818 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:50:02.243416 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-d39dc31a-9dec-4f53-a16f-e7a4dc02f818 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:50:02.243854 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-d39dc31a-9dec-4f53-a16f-e7a4dc02f818 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:50:02.501075 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-d39dc31a-9dec-4f53-a16f-e7a4dc02f818 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:50:02.509073 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-d39dc31a-9dec-4f53-a16f-e7a4dc02f818 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:50:02.510567 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-d39dc31a-9dec-4f53-a16f-e7a4dc02f818 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:50:02.511660 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-d39dc31a-9dec-4f53-a16f-e7a4dc02f818 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] 10.222.0.30 "GET /compute/v2.1/servers/d2c0f276-f763-4337-a5dd-0c328c8c2e73" status: 200 len: 1407 microversion: 2.20 time: 0.280977 Dec 24 10:50:02.512351 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 391/788] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Dec 24 10:50:02 2021] GET /compute/v2.1/servers/d2c0f276-f763-4337-a5dd-0c328c8c2e73 => generated 1407 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 10:50:03.218643 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-6d8001f8-efc0-4b3c-ac67-9446cb5b67da tempest-VolumesNegativeTest-1999238818 tempest-VolumesNegativeTest-1999238818-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:50:03.219247 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-6d8001f8-efc0-4b3c-ac67-9446cb5b67da tempest-VolumesNegativeTest-1999238818 tempest-VolumesNegativeTest-1999238818-project] [instance: 4652b76e-2f6a-459c-a8f8-0d7badb48e4b] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:50:03.225752 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-6d8001f8-efc0-4b3c-ac67-9446cb5b67da tempest-VolumesNegativeTest-1999238818 tempest-VolumesNegativeTest-1999238818-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:50:03.226224 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-6d8001f8-efc0-4b3c-ac67-9446cb5b67da tempest-VolumesNegativeTest-1999238818 tempest-VolumesNegativeTest-1999238818-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:50:03.227030 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-6d8001f8-efc0-4b3c-ac67-9446cb5b67da tempest-VolumesNegativeTest-1999238818 tempest-VolumesNegativeTest-1999238818-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:50:03.227458 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-6d8001f8-efc0-4b3c-ac67-9446cb5b67da tempest-VolumesNegativeTest-1999238818 tempest-VolumesNegativeTest-1999238818-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:50:03.364571 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-6d8001f8-efc0-4b3c-ac67-9446cb5b67da tempest-VolumesNegativeTest-1999238818 tempest-VolumesNegativeTest-1999238818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1388ed800fab47adbe500bc0fa3265a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f6eb4208cd44353b71f263b6ec1aaa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:50:03.371791 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-6d8001f8-efc0-4b3c-ac67-9446cb5b67da tempest-VolumesNegativeTest-1999238818 tempest-VolumesNegativeTest-1999238818-project] 10.222.0.30 "GET /compute/v2.1/servers/4652b76e-2f6a-459c-a8f8-0d7badb48e4b" status: 200 len: 1314 microversion: 2.1 time: 0.156818 Dec 24 10:50:03.372351 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 398/789] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:50:03 2021] GET /compute/v2.1/servers/4652b76e-2f6a-459c-a8f8-0d7badb48e4b => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 24 10:50:03.530340 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-39e0ded7-2e1b-415b-be2b-9b1bc71783d0 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:50:03.530888 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-39e0ded7-2e1b-415b-be2b-9b1bc71783d0 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] [instance: d2c0f276-f763-4337-a5dd-0c328c8c2e73] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:50:03.537173 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-39e0ded7-2e1b-415b-be2b-9b1bc71783d0 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:50:03.537671 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-39e0ded7-2e1b-415b-be2b-9b1bc71783d0 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:50:03.538439 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-39e0ded7-2e1b-415b-be2b-9b1bc71783d0 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:50:03.538927 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-39e0ded7-2e1b-415b-be2b-9b1bc71783d0 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:50:03.677490 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-39e0ded7-2e1b-415b-be2b-9b1bc71783d0 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:50:03.686000 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-39e0ded7-2e1b-415b-be2b-9b1bc71783d0 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:50:03.687702 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-39e0ded7-2e1b-415b-be2b-9b1bc71783d0 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:50:03.688881 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-39e0ded7-2e1b-415b-be2b-9b1bc71783d0 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] 10.222.0.30 "GET /compute/v2.1/servers/d2c0f276-f763-4337-a5dd-0c328c8c2e73" status: 200 len: 1407 microversion: 2.20 time: 0.162805 Dec 24 10:50:03.695303 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 392/790] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Dec 24 10:50:03 2021] GET /compute/v2.1/servers/d2c0f276-f763-4337-a5dd-0c328c8c2e73 => generated 1407 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 24 10:50:04.393249 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-ab8d26e0-891e-407c-a10f-c2fe49a57351 tempest-VolumesNegativeTest-1999238818 tempest-VolumesNegativeTest-1999238818-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:50:04.393249 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-ab8d26e0-891e-407c-a10f-c2fe49a57351 tempest-VolumesNegativeTest-1999238818 tempest-VolumesNegativeTest-1999238818-project] [instance: 4652b76e-2f6a-459c-a8f8-0d7badb48e4b] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:50:04.394828 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-ab8d26e0-891e-407c-a10f-c2fe49a57351 tempest-VolumesNegativeTest-1999238818 tempest-VolumesNegativeTest-1999238818-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:50:04.395281 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-ab8d26e0-891e-407c-a10f-c2fe49a57351 tempest-VolumesNegativeTest-1999238818 tempest-VolumesNegativeTest-1999238818-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:50:04.396063 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-ab8d26e0-891e-407c-a10f-c2fe49a57351 tempest-VolumesNegativeTest-1999238818 tempest-VolumesNegativeTest-1999238818-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:50:04.396545 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-ab8d26e0-891e-407c-a10f-c2fe49a57351 tempest-VolumesNegativeTest-1999238818 tempest-VolumesNegativeTest-1999238818-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:50:04.522144 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-ab8d26e0-891e-407c-a10f-c2fe49a57351 tempest-VolumesNegativeTest-1999238818 tempest-VolumesNegativeTest-1999238818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1388ed800fab47adbe500bc0fa3265a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f6eb4208cd44353b71f263b6ec1aaa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:50:04.529848 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-ab8d26e0-891e-407c-a10f-c2fe49a57351 tempest-VolumesNegativeTest-1999238818 tempest-VolumesNegativeTest-1999238818-project] 10.222.0.30 "GET /compute/v2.1/servers/4652b76e-2f6a-459c-a8f8-0d7badb48e4b" status: 200 len: 1314 microversion: 2.1 time: 0.145793 Dec 24 10:50:04.530404 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 399/791] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:50:04 2021] GET /compute/v2.1/servers/4652b76e-2f6a-459c-a8f8-0d7badb48e4b => generated 1314 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:50:04.707057 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-c0aec6a8-9833-4c55-a994-d2cc0a89407d tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:50:04.707566 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-c0aec6a8-9833-4c55-a994-d2cc0a89407d tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] [instance: d2c0f276-f763-4337-a5dd-0c328c8c2e73] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:50:04.714565 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-c0aec6a8-9833-4c55-a994-d2cc0a89407d tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:50:04.715063 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-c0aec6a8-9833-4c55-a994-d2cc0a89407d tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:50:04.715851 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-c0aec6a8-9833-4c55-a994-d2cc0a89407d tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:50:04.716663 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-c0aec6a8-9833-4c55-a994-d2cc0a89407d tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:50:04.848921 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-c0aec6a8-9833-4c55-a994-d2cc0a89407d tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:50:04.856687 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-c0aec6a8-9833-4c55-a994-d2cc0a89407d tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:50:04.858337 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-c0aec6a8-9833-4c55-a994-d2cc0a89407d tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:50:04.859435 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-c0aec6a8-9833-4c55-a994-d2cc0a89407d tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] 10.222.0.30 "GET /compute/v2.1/servers/d2c0f276-f763-4337-a5dd-0c328c8c2e73" status: 200 len: 1407 microversion: 2.20 time: 0.156142 Dec 24 10:50:04.860174 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 393/792] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Dec 24 10:50:04 2021] GET /compute/v2.1/servers/d2c0f276-f763-4337-a5dd-0c328c8c2e73 => generated 1407 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 10:50:05.546455 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-d7a0d4ec-062c-4101-ab61-2833423544a5 tempest-VolumesNegativeTest-1999238818 tempest-VolumesNegativeTest-1999238818-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:50:05.547052 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-d7a0d4ec-062c-4101-ab61-2833423544a5 tempest-VolumesNegativeTest-1999238818 tempest-VolumesNegativeTest-1999238818-project] [instance: 4652b76e-2f6a-459c-a8f8-0d7badb48e4b] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:50:05.553187 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-d7a0d4ec-062c-4101-ab61-2833423544a5 tempest-VolumesNegativeTest-1999238818 tempest-VolumesNegativeTest-1999238818-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:50:05.553631 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-d7a0d4ec-062c-4101-ab61-2833423544a5 tempest-VolumesNegativeTest-1999238818 tempest-VolumesNegativeTest-1999238818-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:50:05.554407 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-d7a0d4ec-062c-4101-ab61-2833423544a5 tempest-VolumesNegativeTest-1999238818 tempest-VolumesNegativeTest-1999238818-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:50:05.554834 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-d7a0d4ec-062c-4101-ab61-2833423544a5 tempest-VolumesNegativeTest-1999238818 tempest-VolumesNegativeTest-1999238818-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:50:05.696541 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-d7a0d4ec-062c-4101-ab61-2833423544a5 tempest-VolumesNegativeTest-1999238818 tempest-VolumesNegativeTest-1999238818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1388ed800fab47adbe500bc0fa3265a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f6eb4208cd44353b71f263b6ec1aaa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:50:05.704224 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-d7a0d4ec-062c-4101-ab61-2833423544a5 tempest-VolumesNegativeTest-1999238818 tempest-VolumesNegativeTest-1999238818-project] 10.222.0.30 "GET /compute/v2.1/servers/4652b76e-2f6a-459c-a8f8-0d7badb48e4b" status: 200 len: 1314 microversion: 2.1 time: 0.161351 Dec 24 10:50:05.704784 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 400/793] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:50:05 2021] GET /compute/v2.1/servers/4652b76e-2f6a-459c-a8f8-0d7badb48e4b => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:50:05.877036 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-c70ac172-8668-419f-9266-ac3084c0c889 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:50:05.878039 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-c70ac172-8668-419f-9266-ac3084c0c889 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] [instance: d2c0f276-f763-4337-a5dd-0c328c8c2e73] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:50:05.884335 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-c70ac172-8668-419f-9266-ac3084c0c889 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:50:05.884782 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-c70ac172-8668-419f-9266-ac3084c0c889 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:50:05.885591 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-c70ac172-8668-419f-9266-ac3084c0c889 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:50:05.886605 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-c70ac172-8668-419f-9266-ac3084c0c889 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:50:06.015724 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-c70ac172-8668-419f-9266-ac3084c0c889 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:50:06.023789 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-c70ac172-8668-419f-9266-ac3084c0c889 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:50:06.025294 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-c70ac172-8668-419f-9266-ac3084c0c889 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:50:06.026401 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-c70ac172-8668-419f-9266-ac3084c0c889 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] 10.222.0.30 "GET /compute/v2.1/servers/d2c0f276-f763-4337-a5dd-0c328c8c2e73" status: 200 len: 1407 microversion: 2.20 time: 0.153013 Dec 24 10:50:06.026955 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 394/794] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Dec 24 10:50:05 2021] GET /compute/v2.1/servers/d2c0f276-f763-4337-a5dd-0c328c8c2e73 => generated 1407 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 10:50:06.720185 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-b9af2f7d-e417-4178-9fb3-d147c82a599c tempest-VolumesNegativeTest-1999238818 tempest-VolumesNegativeTest-1999238818-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:50:06.720790 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-b9af2f7d-e417-4178-9fb3-d147c82a599c tempest-VolumesNegativeTest-1999238818 tempest-VolumesNegativeTest-1999238818-project] [instance: 4652b76e-2f6a-459c-a8f8-0d7badb48e4b] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:50:06.727206 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-b9af2f7d-e417-4178-9fb3-d147c82a599c tempest-VolumesNegativeTest-1999238818 tempest-VolumesNegativeTest-1999238818-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:50:06.727702 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-b9af2f7d-e417-4178-9fb3-d147c82a599c tempest-VolumesNegativeTest-1999238818 tempest-VolumesNegativeTest-1999238818-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:50:06.728487 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-b9af2f7d-e417-4178-9fb3-d147c82a599c tempest-VolumesNegativeTest-1999238818 tempest-VolumesNegativeTest-1999238818-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:50:06.728943 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-b9af2f7d-e417-4178-9fb3-d147c82a599c tempest-VolumesNegativeTest-1999238818 tempest-VolumesNegativeTest-1999238818-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:50:06.883825 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-b9af2f7d-e417-4178-9fb3-d147c82a599c tempest-VolumesNegativeTest-1999238818 tempest-VolumesNegativeTest-1999238818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1388ed800fab47adbe500bc0fa3265a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f6eb4208cd44353b71f263b6ec1aaa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:50:06.891673 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-b9af2f7d-e417-4178-9fb3-d147c82a599c tempest-VolumesNegativeTest-1999238818 tempest-VolumesNegativeTest-1999238818-project] 10.222.0.30 "GET /compute/v2.1/servers/4652b76e-2f6a-459c-a8f8-0d7badb48e4b" status: 200 len: 1314 microversion: 2.1 time: 0.175089 Dec 24 10:50:06.892238 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 401/795] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:50:06 2021] GET /compute/v2.1/servers/4652b76e-2f6a-459c-a8f8-0d7badb48e4b => generated 1314 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:50:07.043774 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-c85c7462-b0e0-4fdd-aa5e-56b519eff141 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:50:07.046205 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-c85c7462-b0e0-4fdd-aa5e-56b519eff141 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] [instance: d2c0f276-f763-4337-a5dd-0c328c8c2e73] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:50:07.051296 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-c85c7462-b0e0-4fdd-aa5e-56b519eff141 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:50:07.051746 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-c85c7462-b0e0-4fdd-aa5e-56b519eff141 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:50:07.052533 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-c85c7462-b0e0-4fdd-aa5e-56b519eff141 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:50:07.052996 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-c85c7462-b0e0-4fdd-aa5e-56b519eff141 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:50:07.182112 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-c85c7462-b0e0-4fdd-aa5e-56b519eff141 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:50:07.190281 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-c85c7462-b0e0-4fdd-aa5e-56b519eff141 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:50:07.191750 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-c85c7462-b0e0-4fdd-aa5e-56b519eff141 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:50:07.192850 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-c85c7462-b0e0-4fdd-aa5e-56b519eff141 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] 10.222.0.30 "GET /compute/v2.1/servers/d2c0f276-f763-4337-a5dd-0c328c8c2e73" status: 200 len: 1407 microversion: 2.20 time: 0.153308 Dec 24 10:50:07.193409 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 395/796] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Dec 24 10:50:07 2021] GET /compute/v2.1/servers/d2c0f276-f763-4337-a5dd-0c328c8c2e73 => generated 1407 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 10:50:07.892408 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [req-6a015199-d4c7-41a0-ab44-a56a0d34e5a4 req-ebb260ff-492e-4776-a73a-f9f7ea2f6da2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2c0f276-f763-4337-a5dd-0c328c8c2e73", "name": "network-vif-plugged", "status": "completed", "tag": "4043d4f5-4811-4ba4-8723-4f04e5548d1c"}]} {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:50:07.894228 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 10:50:07.894228 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: warnings.warn(msg) Dec 24 10:50:07.901860 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [req-6a015199-d4c7-41a0-ab44-a56a0d34e5a4 req-ebb260ff-492e-4776-a73a-f9f7ea2f6da2 service nova] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:50:07.902303 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [req-6a015199-d4c7-41a0-ab44-a56a0d34e5a4 req-ebb260ff-492e-4776-a73a-f9f7ea2f6da2 service nova] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:50:07.907945 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-f654611c-d7d4-44ab-ada6-2f722303f022 tempest-VolumesNegativeTest-1999238818 tempest-VolumesNegativeTest-1999238818-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:50:07.908607 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-f654611c-d7d4-44ab-ada6-2f722303f022 tempest-VolumesNegativeTest-1999238818 tempest-VolumesNegativeTest-1999238818-project] [instance: 4652b76e-2f6a-459c-a8f8-0d7badb48e4b] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:50:07.913040 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.compute.server_external_events [req-6a015199-d4c7-41a0-ab44-a56a0d34e5a4 req-ebb260ff-492e-4776-a73a-f9f7ea2f6da2 service nova] Creating event network-vif-plugged:4043d4f5-4811-4ba4-8723-4f04e5548d1c for instance d2c0f276-f763-4337-a5dd-0c328c8c2e73 on hv-cinder-81644 Dec 24 10:50:07.914363 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-f654611c-d7d4-44ab-ada6-2f722303f022 tempest-VolumesNegativeTest-1999238818 tempest-VolumesNegativeTest-1999238818-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:50:07.914799 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-f654611c-d7d4-44ab-ada6-2f722303f022 tempest-VolumesNegativeTest-1999238818 tempest-VolumesNegativeTest-1999238818-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:50:07.915564 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-f654611c-d7d4-44ab-ada6-2f722303f022 tempest-VolumesNegativeTest-1999238818 tempest-VolumesNegativeTest-1999238818-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:50:07.915990 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-f654611c-d7d4-44ab-ada6-2f722303f022 tempest-VolumesNegativeTest-1999238818 tempest-VolumesNegativeTest-1999238818-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:50:07.918332 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [req-6a015199-d4c7-41a0-ab44-a56a0d34e5a4 req-ebb260ff-492e-4776-a73a-f9f7ea2f6da2 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029418 Dec 24 10:50:07.919136 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 402/797] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Dec 24 10:50:07 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 24 10:50:08.060174 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-f654611c-d7d4-44ab-ada6-2f722303f022 tempest-VolumesNegativeTest-1999238818 tempest-VolumesNegativeTest-1999238818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1388ed800fab47adbe500bc0fa3265a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f6eb4208cd44353b71f263b6ec1aaa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:50:08.077519 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-f654611c-d7d4-44ab-ada6-2f722303f022 tempest-VolumesNegativeTest-1999238818 tempest-VolumesNegativeTest-1999238818-project] 10.222.0.30 "GET /compute/v2.1/servers/4652b76e-2f6a-459c-a8f8-0d7badb48e4b" status: 200 len: 1314 microversion: 2.1 time: 0.172939 Dec 24 10:50:08.078042 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 396/798] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:50:07 2021] GET /compute/v2.1/servers/4652b76e-2f6a-459c-a8f8-0d7badb48e4b => generated 1314 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:50:08.211211 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-46c86aff-0e26-4c78-a29e-ab97c3e06020 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:50:08.211897 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-46c86aff-0e26-4c78-a29e-ab97c3e06020 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] [instance: d2c0f276-f763-4337-a5dd-0c328c8c2e73] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:50:08.218038 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-46c86aff-0e26-4c78-a29e-ab97c3e06020 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:50:08.218625 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-46c86aff-0e26-4c78-a29e-ab97c3e06020 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:50:08.219409 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-46c86aff-0e26-4c78-a29e-ab97c3e06020 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:50:08.220243 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-46c86aff-0e26-4c78-a29e-ab97c3e06020 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:50:08.417628 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-46c86aff-0e26-4c78-a29e-ab97c3e06020 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:50:08.425269 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-46c86aff-0e26-4c78-a29e-ab97c3e06020 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:50:08.426741 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-46c86aff-0e26-4c78-a29e-ab97c3e06020 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:50:08.427822 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-46c86aff-0e26-4c78-a29e-ab97c3e06020 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] 10.222.0.30 "GET /compute/v2.1/servers/d2c0f276-f763-4337-a5dd-0c328c8c2e73" status: 200 len: 1407 microversion: 2.20 time: 0.221819 Dec 24 10:50:08.428370 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 403/799] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Dec 24 10:50:08 2021] GET /compute/v2.1/servers/d2c0f276-f763-4337-a5dd-0c328c8c2e73 => generated 1407 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 10:50:09.094428 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-e1542723-dcae-45f9-a8bf-1b020791f571 tempest-VolumesNegativeTest-1999238818 tempest-VolumesNegativeTest-1999238818-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:50:09.095038 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-e1542723-dcae-45f9-a8bf-1b020791f571 tempest-VolumesNegativeTest-1999238818 tempest-VolumesNegativeTest-1999238818-project] [instance: 4652b76e-2f6a-459c-a8f8-0d7badb48e4b] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:50:09.101318 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-e1542723-dcae-45f9-a8bf-1b020791f571 tempest-VolumesNegativeTest-1999238818 tempest-VolumesNegativeTest-1999238818-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:50:09.101767 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-e1542723-dcae-45f9-a8bf-1b020791f571 tempest-VolumesNegativeTest-1999238818 tempest-VolumesNegativeTest-1999238818-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:50:09.102551 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-e1542723-dcae-45f9-a8bf-1b020791f571 tempest-VolumesNegativeTest-1999238818 tempest-VolumesNegativeTest-1999238818-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:50:09.102993 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-e1542723-dcae-45f9-a8bf-1b020791f571 tempest-VolumesNegativeTest-1999238818 tempest-VolumesNegativeTest-1999238818-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:50:09.230570 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-e1542723-dcae-45f9-a8bf-1b020791f571 tempest-VolumesNegativeTest-1999238818 tempest-VolumesNegativeTest-1999238818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1388ed800fab47adbe500bc0fa3265a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f6eb4208cd44353b71f263b6ec1aaa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:50:09.238144 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-e1542723-dcae-45f9-a8bf-1b020791f571 tempest-VolumesNegativeTest-1999238818 tempest-VolumesNegativeTest-1999238818-project] 10.222.0.30 "GET /compute/v2.1/servers/4652b76e-2f6a-459c-a8f8-0d7badb48e4b" status: 200 len: 1314 microversion: 2.1 time: 0.147368 Dec 24 10:50:09.238717 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 397/800] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:50:09 2021] GET /compute/v2.1/servers/4652b76e-2f6a-459c-a8f8-0d7badb48e4b => generated 1314 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:50:09.445732 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-9f4199f8-767e-4bce-ba97-21d5f0623260 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:50:09.446336 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-9f4199f8-767e-4bce-ba97-21d5f0623260 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] [instance: d2c0f276-f763-4337-a5dd-0c328c8c2e73] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:50:09.460130 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-9f4199f8-767e-4bce-ba97-21d5f0623260 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:50:09.460546 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-9f4199f8-767e-4bce-ba97-21d5f0623260 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:50:09.461378 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-9f4199f8-767e-4bce-ba97-21d5f0623260 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:50:09.461812 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-9f4199f8-767e-4bce-ba97-21d5f0623260 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:50:09.593640 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-9f4199f8-767e-4bce-ba97-21d5f0623260 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:50:09.601233 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-9f4199f8-767e-4bce-ba97-21d5f0623260 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:50:09.602712 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-9f4199f8-767e-4bce-ba97-21d5f0623260 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:50:09.603990 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-9f4199f8-767e-4bce-ba97-21d5f0623260 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] 10.222.0.30 "GET /compute/v2.1/servers/d2c0f276-f763-4337-a5dd-0c328c8c2e73" status: 200 len: 1407 microversion: 2.20 time: 0.161787 Dec 24 10:50:09.604335 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 404/801] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Dec 24 10:50:09 2021] GET /compute/v2.1/servers/d2c0f276-f763-4337-a5dd-0c328c8c2e73 => generated 1407 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 10:50:09.933321 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [req-aa7ac9e1-185e-401f-8584-3a7081aecc78 req-5c203f6a-1b28-4db5-bd0c-85fdd314eaf5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4652b76e-2f6a-459c-a8f8-0d7badb48e4b", "name": "network-vif-plugged", "status": "completed", "tag": "58497630-c432-4354-b00e-fcc9f4b8b268"}]} {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:50:09.934875 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 10:50:09.934875 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: warnings.warn(msg) Dec 24 10:50:09.942290 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [req-aa7ac9e1-185e-401f-8584-3a7081aecc78 req-5c203f6a-1b28-4db5-bd0c-85fdd314eaf5 service nova] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:50:09.942290 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [req-aa7ac9e1-185e-401f-8584-3a7081aecc78 req-5c203f6a-1b28-4db5-bd0c-85fdd314eaf5 service nova] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:50:09.952435 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.compute.server_external_events [req-aa7ac9e1-185e-401f-8584-3a7081aecc78 req-5c203f6a-1b28-4db5-bd0c-85fdd314eaf5 service nova] Creating event network-vif-plugged:58497630-c432-4354-b00e-fcc9f4b8b268 for instance 4652b76e-2f6a-459c-a8f8-0d7badb48e4b on hv-cinder-81644 Dec 24 10:50:09.957345 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [req-aa7ac9e1-185e-401f-8584-3a7081aecc78 req-5c203f6a-1b28-4db5-bd0c-85fdd314eaf5 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028333 Dec 24 10:50:09.958122 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 398/802] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Dec 24 10:50:09 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 10:50:10.254416 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-823c1607-1c7d-40c4-81fc-658a54a40290 tempest-VolumesNegativeTest-1999238818 tempest-VolumesNegativeTest-1999238818-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:50:10.255022 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-823c1607-1c7d-40c4-81fc-658a54a40290 tempest-VolumesNegativeTest-1999238818 tempest-VolumesNegativeTest-1999238818-project] [instance: 4652b76e-2f6a-459c-a8f8-0d7badb48e4b] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:50:10.260943 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-823c1607-1c7d-40c4-81fc-658a54a40290 tempest-VolumesNegativeTest-1999238818 tempest-VolumesNegativeTest-1999238818-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:50:10.261391 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-823c1607-1c7d-40c4-81fc-658a54a40290 tempest-VolumesNegativeTest-1999238818 tempest-VolumesNegativeTest-1999238818-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:50:10.262172 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-823c1607-1c7d-40c4-81fc-658a54a40290 tempest-VolumesNegativeTest-1999238818 tempest-VolumesNegativeTest-1999238818-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:50:10.262605 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-823c1607-1c7d-40c4-81fc-658a54a40290 tempest-VolumesNegativeTest-1999238818 tempest-VolumesNegativeTest-1999238818-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:50:10.404751 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-823c1607-1c7d-40c4-81fc-658a54a40290 tempest-VolumesNegativeTest-1999238818 tempest-VolumesNegativeTest-1999238818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1388ed800fab47adbe500bc0fa3265a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f6eb4208cd44353b71f263b6ec1aaa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:50:10.412129 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-823c1607-1c7d-40c4-81fc-658a54a40290 tempest-VolumesNegativeTest-1999238818 tempest-VolumesNegativeTest-1999238818-project] 10.222.0.30 "GET /compute/v2.1/servers/4652b76e-2f6a-459c-a8f8-0d7badb48e4b" status: 200 len: 1314 microversion: 2.1 time: 0.161275 Dec 24 10:50:10.412687 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 405/803] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:50:10 2021] GET /compute/v2.1/servers/4652b76e-2f6a-459c-a8f8-0d7badb48e4b => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:50:10.621977 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-ad2c05af-ddb7-4915-8fc8-2250bfc2aec3 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:50:10.622581 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-ad2c05af-ddb7-4915-8fc8-2250bfc2aec3 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] [instance: d2c0f276-f763-4337-a5dd-0c328c8c2e73] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:50:10.629071 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-ad2c05af-ddb7-4915-8fc8-2250bfc2aec3 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:50:10.629511 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-ad2c05af-ddb7-4915-8fc8-2250bfc2aec3 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:50:10.630281 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-ad2c05af-ddb7-4915-8fc8-2250bfc2aec3 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:50:10.632059 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-ad2c05af-ddb7-4915-8fc8-2250bfc2aec3 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:50:10.762618 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-ad2c05af-ddb7-4915-8fc8-2250bfc2aec3 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:50:10.770570 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-ad2c05af-ddb7-4915-8fc8-2250bfc2aec3 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:50:10.772052 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-ad2c05af-ddb7-4915-8fc8-2250bfc2aec3 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:50:10.773215 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-ad2c05af-ddb7-4915-8fc8-2250bfc2aec3 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] 10.222.0.30 "GET /compute/v2.1/servers/d2c0f276-f763-4337-a5dd-0c328c8c2e73" status: 200 len: 1598 microversion: 2.20 time: 0.155284 Dec 24 10:50:10.773779 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 399/804] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Dec 24 10:50:10 2021] GET /compute/v2.1/servers/d2c0f276-f763-4337-a5dd-0c328c8c2e73 => generated 1598 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 10:50:11.007508 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-dd11192e-d1b5-4933-bfa2-5fdfb591fd18 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:50:11.007986 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-dd11192e-d1b5-4933-bfa2-5fdfb591fd18 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] [instance: d2c0f276-f763-4337-a5dd-0c328c8c2e73] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:50:11.013733 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-dd11192e-d1b5-4933-bfa2-5fdfb591fd18 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:50:11.014178 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-dd11192e-d1b5-4933-bfa2-5fdfb591fd18 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:50:11.015159 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-dd11192e-d1b5-4933-bfa2-5fdfb591fd18 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:50:11.015597 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-dd11192e-d1b5-4933-bfa2-5fdfb591fd18 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:50:11.095582 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-dd11192e-d1b5-4933-bfa2-5fdfb591fd18 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] 10.222.0.30 "GET /compute/v2.1/servers/d2c0f276-f763-4337-a5dd-0c328c8c2e73/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.308714 Dec 24 10:50:11.096213 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 406/805] 10.222.0.30 () {60 vars in 1315 bytes} [Fri Dec 24 10:50:10 2021] GET /compute/v2.1/servers/d2c0f276-f763-4337-a5dd-0c328c8c2e73/os-interface => generated 284 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 24 10:50:11.183816 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-2221bd24-89b9-4aea-bed0-a3b974603b2a tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1125894519"}} {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:50:11.184806 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-2221bd24-89b9-4aea-bed0-a3b974603b2a tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] [instance: 12183d8e-4c50-449a-a93d-cee72f597b3d] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:50:11.191112 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-2221bd24-89b9-4aea-bed0-a3b974603b2a tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:50:11.191711 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-2221bd24-89b9-4aea-bed0-a3b974603b2a tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:50:11.192660 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-2221bd24-89b9-4aea-bed0-a3b974603b2a tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:50:11.193263 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-2221bd24-89b9-4aea-bed0-a3b974603b2a tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:50:11.326062 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.network.security_group_api [None req-2221bd24-89b9-4aea-bed0-a3b974603b2a tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Removing security group 3b8958a9-d372-4911-8d35-3c880723732b from port abebf56e-a643-48ae-a779-897dbd105170 Dec 24 10:50:11.428269 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-3163bd86-31f7-4562-980d-be0c1b878dc2 tempest-VolumesNegativeTest-1999238818 tempest-VolumesNegativeTest-1999238818-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:50:11.428913 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-3163bd86-31f7-4562-980d-be0c1b878dc2 tempest-VolumesNegativeTest-1999238818 tempest-VolumesNegativeTest-1999238818-project] [instance: 4652b76e-2f6a-459c-a8f8-0d7badb48e4b] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:50:11.437921 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-3163bd86-31f7-4562-980d-be0c1b878dc2 tempest-VolumesNegativeTest-1999238818 tempest-VolumesNegativeTest-1999238818-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:50:11.437921 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-3163bd86-31f7-4562-980d-be0c1b878dc2 tempest-VolumesNegativeTest-1999238818 tempest-VolumesNegativeTest-1999238818-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:50:11.437921 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-3163bd86-31f7-4562-980d-be0c1b878dc2 tempest-VolumesNegativeTest-1999238818 tempest-VolumesNegativeTest-1999238818-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:50:11.437921 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-3163bd86-31f7-4562-980d-be0c1b878dc2 tempest-VolumesNegativeTest-1999238818 tempest-VolumesNegativeTest-1999238818-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:50:11.709318 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-3163bd86-31f7-4562-980d-be0c1b878dc2 tempest-VolumesNegativeTest-1999238818 tempest-VolumesNegativeTest-1999238818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1388ed800fab47adbe500bc0fa3265a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f6eb4208cd44353b71f263b6ec1aaa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:50:11.718712 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-3163bd86-31f7-4562-980d-be0c1b878dc2 tempest-VolumesNegativeTest-1999238818 tempest-VolumesNegativeTest-1999238818-project] 10.222.0.30 "GET /compute/v2.1/servers/4652b76e-2f6a-459c-a8f8-0d7badb48e4b" status: 200 len: 1314 microversion: 2.1 time: 0.294104 Dec 24 10:50:11.729459 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 407/806] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:50:11 2021] GET /compute/v2.1/servers/4652b76e-2f6a-459c-a8f8-0d7badb48e4b => generated 1314 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 24 10:50:11.824252 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-2221bd24-89b9-4aea-bed0-a3b974603b2a tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] 10.222.0.30 "POST /compute/v2.1/servers/12183d8e-4c50-449a-a93d-cee72f597b3d/action" status: 202 len: 0 microversion: 2.1 time: 0.645172 Dec 24 10:50:11.825134 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 400/807] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Dec 24 10:50:11 2021] POST /compute/v2.1/servers/12183d8e-4c50-449a-a93d-cee72f597b3d/action => generated 0 bytes in 647 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 24 10:50:11.845433 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [req-80bd1e11-6edf-4777-9269-a83f5dcc6a80 req-a2bce9f9-7f75-4053-ae81-63a7eef9a33d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "12183d8e-4c50-449a-a93d-cee72f597b3d", "tag": "abebf56e-a643-48ae-a779-897dbd105170"}]} {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:50:11.845433 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 10:50:11.845433 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: warnings.warn(msg) Dec 24 10:50:11.850955 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [req-80bd1e11-6edf-4777-9269-a83f5dcc6a80 req-a2bce9f9-7f75-4053-ae81-63a7eef9a33d service nova] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:50:11.861629 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [req-80bd1e11-6edf-4777-9269-a83f5dcc6a80 req-a2bce9f9-7f75-4053-ae81-63a7eef9a33d service nova] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:50:11.884496 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.compute.server_external_events [req-80bd1e11-6edf-4777-9269-a83f5dcc6a80 req-a2bce9f9-7f75-4053-ae81-63a7eef9a33d service nova] Creating event network-changed:abebf56e-a643-48ae-a779-897dbd105170 for instance 12183d8e-4c50-449a-a93d-cee72f597b3d on hv-cinder-81644 Dec 24 10:50:11.891162 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [req-80bd1e11-6edf-4777-9269-a83f5dcc6a80 req-a2bce9f9-7f75-4053-ae81-63a7eef9a33d service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052608 Dec 24 10:50:11.892467 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 408/808] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Dec 24 10:50:11 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 10:50:12.736795 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-38975387-c215-4156-9e70-1ab304133c9c tempest-VolumesNegativeTest-1999238818 tempest-VolumesNegativeTest-1999238818-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:50:12.737464 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-38975387-c215-4156-9e70-1ab304133c9c tempest-VolumesNegativeTest-1999238818 tempest-VolumesNegativeTest-1999238818-project] [instance: 4652b76e-2f6a-459c-a8f8-0d7badb48e4b] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:50:12.744357 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-38975387-c215-4156-9e70-1ab304133c9c tempest-VolumesNegativeTest-1999238818 tempest-VolumesNegativeTest-1999238818-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:50:12.746360 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-38975387-c215-4156-9e70-1ab304133c9c tempest-VolumesNegativeTest-1999238818 tempest-VolumesNegativeTest-1999238818-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:50:12.755044 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-38975387-c215-4156-9e70-1ab304133c9c tempest-VolumesNegativeTest-1999238818 tempest-VolumesNegativeTest-1999238818-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:50:12.755044 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-38975387-c215-4156-9e70-1ab304133c9c tempest-VolumesNegativeTest-1999238818 tempest-VolumesNegativeTest-1999238818-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:50:12.837594 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-cea0814d-0cd5-4c58-968c-1b2afb5c8dc8 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:50:12.839386 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-cea0814d-0cd5-4c58-968c-1b2afb5c8dc8 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] [instance: d2c0f276-f763-4337-a5dd-0c328c8c2e73] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:50:12.851254 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-cea0814d-0cd5-4c58-968c-1b2afb5c8dc8 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:50:12.851714 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-cea0814d-0cd5-4c58-968c-1b2afb5c8dc8 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:50:12.852525 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-cea0814d-0cd5-4c58-968c-1b2afb5c8dc8 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:50:12.852997 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-cea0814d-0cd5-4c58-968c-1b2afb5c8dc8 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:50:12.922906 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-cea0814d-0cd5-4c58-968c-1b2afb5c8dc8 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] 10.222.0.30 "POST /compute/v2.1/servers/d2c0f276-f763-4337-a5dd-0c328c8c2e73/action" status: 200 len: 14 microversion: 2.20 time: 0.095801 Dec 24 10:50:12.925375 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 409/809] 10.222.0.30 () {62 vars in 1318 bytes} [Fri Dec 24 10:50:12 2021] POST /compute/v2.1/servers/d2c0f276-f763-4337-a5dd-0c328c8c2e73/action => generated 14 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:50:12.928862 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [req-31808756-0b7c-4f30-a521-a307d07f4dc7 req-b8deabcb-e699-4b62-8262-46f43ec483fe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d2c0f276-f763-4337-a5dd-0c328c8c2e73", "tag": "4043d4f5-4811-4ba4-8723-4f04e5548d1c"}]} {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:50:12.930529 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 10:50:12.930529 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: warnings.warn(msg) Dec 24 10:50:12.939891 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [req-31808756-0b7c-4f30-a521-a307d07f4dc7 req-b8deabcb-e699-4b62-8262-46f43ec483fe service nova] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:50:12.940662 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [req-31808756-0b7c-4f30-a521-a307d07f4dc7 req-b8deabcb-e699-4b62-8262-46f43ec483fe service nova] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:50:12.954697 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.compute.server_external_events [req-31808756-0b7c-4f30-a521-a307d07f4dc7 req-b8deabcb-e699-4b62-8262-46f43ec483fe service nova] Creating event network-changed:4043d4f5-4811-4ba4-8723-4f04e5548d1c for instance d2c0f276-f763-4337-a5dd-0c328c8c2e73 on hv-cinder-81644 Dec 24 10:50:12.960774 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [req-31808756-0b7c-4f30-a521-a307d07f4dc7 req-b8deabcb-e699-4b62-8262-46f43ec483fe service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035351 Dec 24 10:50:12.961844 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 410/810] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Dec 24 10:50:12 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 10:50:12.987763 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-38975387-c215-4156-9e70-1ab304133c9c tempest-VolumesNegativeTest-1999238818 tempest-VolumesNegativeTest-1999238818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1388ed800fab47adbe500bc0fa3265a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f6eb4208cd44353b71f263b6ec1aaa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:50:12.996521 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-38975387-c215-4156-9e70-1ab304133c9c tempest-VolumesNegativeTest-1999238818 tempest-VolumesNegativeTest-1999238818-project] 10.222.0.30 "GET /compute/v2.1/servers/4652b76e-2f6a-459c-a8f8-0d7badb48e4b" status: 200 len: 1463 microversion: 2.1 time: 0.263241 Dec 24 10:50:13.009200 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 401/811] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:50:12 2021] GET /compute/v2.1/servers/4652b76e-2f6a-459c-a8f8-0d7badb48e4b => generated 1463 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:50:13.047612 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-3d986850-c59e-4c1e-aa88-79a8ea048c57 tempest-VolumesNegativeTest-1999238818 tempest-VolumesNegativeTest-1999238818-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:50:13.048208 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-3d986850-c59e-4c1e-aa88-79a8ea048c57 tempest-VolumesNegativeTest-1999238818 tempest-VolumesNegativeTest-1999238818-project] [instance: 4652b76e-2f6a-459c-a8f8-0d7badb48e4b] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:50:13.069398 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-3d986850-c59e-4c1e-aa88-79a8ea048c57 tempest-VolumesNegativeTest-1999238818 tempest-VolumesNegativeTest-1999238818-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:50:13.069398 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-3d986850-c59e-4c1e-aa88-79a8ea048c57 tempest-VolumesNegativeTest-1999238818 tempest-VolumesNegativeTest-1999238818-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:50:13.069398 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-3d986850-c59e-4c1e-aa88-79a8ea048c57 tempest-VolumesNegativeTest-1999238818 tempest-VolumesNegativeTest-1999238818-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:50:13.069398 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-3d986850-c59e-4c1e-aa88-79a8ea048c57 tempest-VolumesNegativeTest-1999238818 tempest-VolumesNegativeTest-1999238818-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:50:13.096134 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-3d986850-c59e-4c1e-aa88-79a8ea048c57 tempest-VolumesNegativeTest-1999238818 tempest-VolumesNegativeTest-1999238818-project] [instance: 4652b76e-2f6a-459c-a8f8-0d7badb48e4b] Going to try to terminate instance {{(pid=123432) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 24 10:50:13.451760 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-3d986850-c59e-4c1e-aa88-79a8ea048c57 tempest-VolumesNegativeTest-1999238818 tempest-VolumesNegativeTest-1999238818-project] 10.222.0.30 "DELETE /compute/v2.1/servers/4652b76e-2f6a-459c-a8f8-0d7badb48e4b" status: 204 len: 0 microversion: 2.1 time: 0.408527 Dec 24 10:50:13.452795 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 411/812] 10.222.0.30 () {58 vars in 1238 bytes} [Fri Dec 24 10:50:13 2021] DELETE /compute/v2.1/servers/4652b76e-2f6a-459c-a8f8-0d7badb48e4b => generated 0 bytes in 410 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 24 10:50:13.461204 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-3edb2108-9b7d-43e9-b841-02c48b7c2467 tempest-VolumesNegativeTest-1999238818 tempest-VolumesNegativeTest-1999238818-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:50:13.461204 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-3edb2108-9b7d-43e9-b841-02c48b7c2467 tempest-VolumesNegativeTest-1999238818 tempest-VolumesNegativeTest-1999238818-project] [instance: 4652b76e-2f6a-459c-a8f8-0d7badb48e4b] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:50:13.466638 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-3edb2108-9b7d-43e9-b841-02c48b7c2467 tempest-VolumesNegativeTest-1999238818 tempest-VolumesNegativeTest-1999238818-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:50:13.467394 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-3edb2108-9b7d-43e9-b841-02c48b7c2467 tempest-VolumesNegativeTest-1999238818 tempest-VolumesNegativeTest-1999238818-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:50:13.468397 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-3edb2108-9b7d-43e9-b841-02c48b7c2467 tempest-VolumesNegativeTest-1999238818 tempest-VolumesNegativeTest-1999238818-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:50:13.469249 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-3edb2108-9b7d-43e9-b841-02c48b7c2467 tempest-VolumesNegativeTest-1999238818 tempest-VolumesNegativeTest-1999238818-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:50:13.615179 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-3edb2108-9b7d-43e9-b841-02c48b7c2467 tempest-VolumesNegativeTest-1999238818 tempest-VolumesNegativeTest-1999238818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1388ed800fab47adbe500bc0fa3265a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f6eb4208cd44353b71f263b6ec1aaa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:50:13.626268 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-3edb2108-9b7d-43e9-b841-02c48b7c2467 tempest-VolumesNegativeTest-1999238818 tempest-VolumesNegativeTest-1999238818-project] 10.222.0.30 "GET /compute/v2.1/servers/4652b76e-2f6a-459c-a8f8-0d7badb48e4b" status: 200 len: 1469 microversion: 2.1 time: 0.169414 Dec 24 10:50:13.627485 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 402/813] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:50:13 2021] GET /compute/v2.1/servers/4652b76e-2f6a-459c-a8f8-0d7badb48e4b => generated 1469 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:50:13.934905 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-e5ac7ed4-6959-40bc-adfc-70401b3bd42a tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:50:13.935920 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-e5ac7ed4-6959-40bc-adfc-70401b3bd42a tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] [instance: d2c0f276-f763-4337-a5dd-0c328c8c2e73] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:50:13.943513 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-e5ac7ed4-6959-40bc-adfc-70401b3bd42a tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:50:13.943964 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-e5ac7ed4-6959-40bc-adfc-70401b3bd42a tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:50:13.945346 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-e5ac7ed4-6959-40bc-adfc-70401b3bd42a tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:50:13.946217 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-e5ac7ed4-6959-40bc-adfc-70401b3bd42a tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:50:14.020680 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-e5ac7ed4-6959-40bc-adfc-70401b3bd42a tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] 10.222.0.30 "POST /compute/v2.1/servers/d2c0f276-f763-4337-a5dd-0c328c8c2e73/action" status: 200 len: 14 microversion: 2.20 time: 0.084340 Dec 24 10:50:14.020680 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 412/814] 10.222.0.30 () {62 vars in 1318 bytes} [Fri Dec 24 10:50:13 2021] POST /compute/v2.1/servers/d2c0f276-f763-4337-a5dd-0c328c8c2e73/action => generated 14 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:50:14.336329 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-d33a8cc4-92ee-4dae-a066-d3891abb3867 tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:50:14.336830 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-d33a8cc4-92ee-4dae-a066-d3891abb3867 tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] [instance: 12183d8e-4c50-449a-a93d-cee72f597b3d] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:50:14.347484 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-d33a8cc4-92ee-4dae-a066-d3891abb3867 tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:50:14.347484 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-d33a8cc4-92ee-4dae-a066-d3891abb3867 tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:50:14.347484 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-d33a8cc4-92ee-4dae-a066-d3891abb3867 tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:50:14.347484 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-d33a8cc4-92ee-4dae-a066-d3891abb3867 tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:50:14.431872 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.objects.instance [None req-d33a8cc4-92ee-4dae-a066-d3891abb3867 tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Lazy-loading 'services' on Instance uuid 12183d8e-4c50-449a-a93d-cee72f597b3d {{(pid=123431) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 24 10:50:14.644017 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-b61bd9fc-c485-4b02-84ce-3472ffcc32cc tempest-VolumesNegativeTest-1999238818 tempest-VolumesNegativeTest-1999238818-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:50:14.644714 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-b61bd9fc-c485-4b02-84ce-3472ffcc32cc tempest-VolumesNegativeTest-1999238818 tempest-VolumesNegativeTest-1999238818-project] [instance: 4652b76e-2f6a-459c-a8f8-0d7badb48e4b] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:50:14.651968 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-b61bd9fc-c485-4b02-84ce-3472ffcc32cc tempest-VolumesNegativeTest-1999238818 tempest-VolumesNegativeTest-1999238818-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:50:14.655364 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-b61bd9fc-c485-4b02-84ce-3472ffcc32cc tempest-VolumesNegativeTest-1999238818 tempest-VolumesNegativeTest-1999238818-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:50:14.655364 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-b61bd9fc-c485-4b02-84ce-3472ffcc32cc tempest-VolumesNegativeTest-1999238818 tempest-VolumesNegativeTest-1999238818-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:50:14.655364 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-b61bd9fc-c485-4b02-84ce-3472ffcc32cc tempest-VolumesNegativeTest-1999238818 tempest-VolumesNegativeTest-1999238818-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:50:14.786860 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-b61bd9fc-c485-4b02-84ce-3472ffcc32cc tempest-VolumesNegativeTest-1999238818 tempest-VolumesNegativeTest-1999238818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1388ed800fab47adbe500bc0fa3265a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f6eb4208cd44353b71f263b6ec1aaa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:50:14.795264 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-b61bd9fc-c485-4b02-84ce-3472ffcc32cc tempest-VolumesNegativeTest-1999238818 tempest-VolumesNegativeTest-1999238818-project] 10.222.0.30 "GET /compute/v2.1/servers/4652b76e-2f6a-459c-a8f8-0d7badb48e4b" status: 200 len: 1469 microversion: 2.1 time: 0.155502 Dec 24 10:50:14.795912 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 413/815] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:50:14 2021] GET /compute/v2.1/servers/4652b76e-2f6a-459c-a8f8-0d7badb48e4b => generated 1469 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 24 10:50:14.825401 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-d33a8cc4-92ee-4dae-a066-d3891abb3867 tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] 10.222.0.30 "DELETE /compute/v2.1/servers/12183d8e-4c50-449a-a93d-cee72f597b3d/os-volume_attachments/305fd416-40bf-4b2b-b6e9-df2600997549" status: 202 len: 0 microversion: 2.1 time: 0.492491 Dec 24 10:50:14.826010 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 403/816] 10.222.0.30 () {58 vars in 1415 bytes} [Fri Dec 24 10:50:14 2021] DELETE /compute/v2.1/servers/12183d8e-4c50-449a-a93d-cee72f597b3d/os-volume_attachments/305fd416-40bf-4b2b-b6e9-df2600997549 => generated 0 bytes in 494 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 24 10:50:14.834147 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-41c2aae2-cc20-4d87-ad33-e5d9cf02b8eb tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:50:14.835057 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-41c2aae2-cc20-4d87-ad33-e5d9cf02b8eb tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] [instance: 12183d8e-4c50-449a-a93d-cee72f597b3d] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:50:14.842446 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-41c2aae2-cc20-4d87-ad33-e5d9cf02b8eb tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:50:14.842895 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-41c2aae2-cc20-4d87-ad33-e5d9cf02b8eb tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:50:14.843883 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-41c2aae2-cc20-4d87-ad33-e5d9cf02b8eb tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:50:14.844470 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-41c2aae2-cc20-4d87-ad33-e5d9cf02b8eb tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:50:14.874465 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-41c2aae2-cc20-4d87-ad33-e5d9cf02b8eb tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] 10.222.0.30 "GET /compute/v2.1/servers/12183d8e-4c50-449a-a93d-cee72f597b3d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043934 Dec 24 10:50:14.875166 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 414/817] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Dec 24 10:50:14 2021] GET /compute/v2.1/servers/12183d8e-4c50-449a-a93d-cee72f597b3d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 10:50:14.984154 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [req-2cdcc545-e75c-48bc-8a73-6c7ab8d1ceaa req-bfb647c7-27b7-4c83-922b-1efa2ed24e71 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "12183d8e-4c50-449a-a93d-cee72f597b3d", "tag": "abebf56e-a643-48ae-a779-897dbd105170"}]} {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:50:14.985722 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 10:50:14.985722 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: warnings.warn(msg) Dec 24 10:50:14.995978 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [req-2cdcc545-e75c-48bc-8a73-6c7ab8d1ceaa req-bfb647c7-27b7-4c83-922b-1efa2ed24e71 service nova] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:50:14.996742 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [req-2cdcc545-e75c-48bc-8a73-6c7ab8d1ceaa req-bfb647c7-27b7-4c83-922b-1efa2ed24e71 service nova] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:50:15.009528 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.compute.server_external_events [req-2cdcc545-e75c-48bc-8a73-6c7ab8d1ceaa req-bfb647c7-27b7-4c83-922b-1efa2ed24e71 service nova] Creating event network-changed:abebf56e-a643-48ae-a779-897dbd105170 for instance 12183d8e-4c50-449a-a93d-cee72f597b3d on hv-cinder-81644 Dec 24 10:50:15.015644 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [req-2cdcc545-e75c-48bc-8a73-6c7ab8d1ceaa req-bfb647c7-27b7-4c83-922b-1efa2ed24e71 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035112 Dec 24 10:50:15.015644 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 404/818] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Dec 24 10:50:14 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 10:50:15.027584 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-384c7203-2201-42c3-aa5a-5ca4a78fbe28 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:50:15.028418 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-384c7203-2201-42c3-aa5a-5ca4a78fbe28 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] [instance: d2c0f276-f763-4337-a5dd-0c328c8c2e73] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:50:15.038418 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-384c7203-2201-42c3-aa5a-5ca4a78fbe28 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:50:15.038924 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-384c7203-2201-42c3-aa5a-5ca4a78fbe28 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:50:15.039809 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-384c7203-2201-42c3-aa5a-5ca4a78fbe28 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:50:15.040405 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-384c7203-2201-42c3-aa5a-5ca4a78fbe28 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:50:15.131045 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-384c7203-2201-42c3-aa5a-5ca4a78fbe28 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] 10.222.0.30 "POST /compute/v2.1/servers/d2c0f276-f763-4337-a5dd-0c328c8c2e73/action" status: 200 len: 14 microversion: 2.20 time: 0.107997 Dec 24 10:50:15.133703 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 415/819] 10.222.0.30 () {62 vars in 1318 bytes} [Fri Dec 24 10:50:15 2021] POST /compute/v2.1/servers/d2c0f276-f763-4337-a5dd-0c328c8c2e73/action => generated 14 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:50:15.782927 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [req-0f1e2087-12b5-4779-843e-42b7e6b8e844 req-37605994-883b-4369-b9f8-f45f0c54bfab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4652b76e-2f6a-459c-a8f8-0d7badb48e4b", "name": "network-vif-deleted", "tag": "58497630-c432-4354-b00e-fcc9f4b8b268"}]} {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:50:15.784409 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 10:50:15.784409 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: warnings.warn(msg) Dec 24 10:50:15.791547 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [req-0f1e2087-12b5-4779-843e-42b7e6b8e844 req-37605994-883b-4369-b9f8-f45f0c54bfab service nova] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:50:15.791979 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [req-0f1e2087-12b5-4779-843e-42b7e6b8e844 req-37605994-883b-4369-b9f8-f45f0c54bfab service nova] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:50:15.803337 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.compute.server_external_events [req-0f1e2087-12b5-4779-843e-42b7e6b8e844 req-37605994-883b-4369-b9f8-f45f0c54bfab service nova] Creating event network-vif-deleted:58497630-c432-4354-b00e-fcc9f4b8b268 for instance 4652b76e-2f6a-459c-a8f8-0d7badb48e4b on hv-cinder-81644 Dec 24 10:50:15.808920 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [req-0f1e2087-12b5-4779-843e-42b7e6b8e844 req-37605994-883b-4369-b9f8-f45f0c54bfab service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030387 Dec 24 10:50:15.809717 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 405/820] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Dec 24 10:50:15 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 10:50:15.815022 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-d91c21ab-dc2f-489f-b275-b300ce351827 tempest-VolumesNegativeTest-1999238818 tempest-VolumesNegativeTest-1999238818-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:50:15.815945 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-d91c21ab-dc2f-489f-b275-b300ce351827 tempest-VolumesNegativeTest-1999238818 tempest-VolumesNegativeTest-1999238818-project] [instance: 4652b76e-2f6a-459c-a8f8-0d7badb48e4b] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:50:15.824432 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-d91c21ab-dc2f-489f-b275-b300ce351827 tempest-VolumesNegativeTest-1999238818 tempest-VolumesNegativeTest-1999238818-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:50:15.824906 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-d91c21ab-dc2f-489f-b275-b300ce351827 tempest-VolumesNegativeTest-1999238818 tempest-VolumesNegativeTest-1999238818-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:50:15.825698 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-d91c21ab-dc2f-489f-b275-b300ce351827 tempest-VolumesNegativeTest-1999238818 tempest-VolumesNegativeTest-1999238818-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:50:15.826300 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-d91c21ab-dc2f-489f-b275-b300ce351827 tempest-VolumesNegativeTest-1999238818 tempest-VolumesNegativeTest-1999238818-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:50:15.887076 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-8ee005e6-2d6d-401a-9ad9-2be425cc6e57 tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:50:15.888066 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-8ee005e6-2d6d-401a-9ad9-2be425cc6e57 tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] [instance: 12183d8e-4c50-449a-a93d-cee72f597b3d] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:50:15.894849 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-8ee005e6-2d6d-401a-9ad9-2be425cc6e57 tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:50:15.895293 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-8ee005e6-2d6d-401a-9ad9-2be425cc6e57 tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:50:15.896076 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-8ee005e6-2d6d-401a-9ad9-2be425cc6e57 tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:50:15.896690 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-8ee005e6-2d6d-401a-9ad9-2be425cc6e57 tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:50:15.914857 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-d91c21ab-dc2f-489f-b275-b300ce351827 tempest-VolumesNegativeTest-1999238818 tempest-VolumesNegativeTest-1999238818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1388ed800fab47adbe500bc0fa3265a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f6eb4208cd44353b71f263b6ec1aaa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:50:15.926830 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-d91c21ab-dc2f-489f-b275-b300ce351827 tempest-VolumesNegativeTest-1999238818 tempest-VolumesNegativeTest-1999238818-project] 10.222.0.30 "GET /compute/v2.1/servers/4652b76e-2f6a-459c-a8f8-0d7badb48e4b" status: 200 len: 1427 microversion: 2.1 time: 0.117775 Dec 24 10:50:15.928399 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-8ee005e6-2d6d-401a-9ad9-2be425cc6e57 tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] 10.222.0.30 "GET /compute/v2.1/servers/12183d8e-4c50-449a-a93d-cee72f597b3d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046190 Dec 24 10:50:15.929483 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 406/821] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Dec 24 10:50:15 2021] GET /compute/v2.1/servers/12183d8e-4c50-449a-a93d-cee72f597b3d/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 24 10:50:15.938917 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 416/822] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:50:15 2021] GET /compute/v2.1/servers/4652b76e-2f6a-459c-a8f8-0d7badb48e4b => generated 1427 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:50:16.141697 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-e72f11a4-3437-4b02-ad1a-4ef9943e6db3 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:50:16.142601 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-e72f11a4-3437-4b02-ad1a-4ef9943e6db3 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] [instance: d2c0f276-f763-4337-a5dd-0c328c8c2e73] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:50:16.148752 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-e72f11a4-3437-4b02-ad1a-4ef9943e6db3 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:50:16.149219 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-e72f11a4-3437-4b02-ad1a-4ef9943e6db3 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:50:16.149998 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-e72f11a4-3437-4b02-ad1a-4ef9943e6db3 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:50:16.150427 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-e72f11a4-3437-4b02-ad1a-4ef9943e6db3 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:50:16.211811 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-e72f11a4-3437-4b02-ad1a-4ef9943e6db3 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] 10.222.0.30 "POST /compute/v2.1/servers/d2c0f276-f763-4337-a5dd-0c328c8c2e73/action" status: 200 len: 14 microversion: 2.20 time: 0.073659 Dec 24 10:50:16.212370 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 407/823] 10.222.0.30 () {62 vars in 1318 bytes} [Fri Dec 24 10:50:16 2021] POST /compute/v2.1/servers/d2c0f276-f763-4337-a5dd-0c328c8c2e73/action => generated 14 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:50:16.941135 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-9d687df8-4f24-4de4-b492-7a9dc946ae69 tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:50:16.942234 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-9d687df8-4f24-4de4-b492-7a9dc946ae69 tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] [instance: 12183d8e-4c50-449a-a93d-cee72f597b3d] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:50:16.945212 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-8e578cf8-24f3-4dbf-a406-15008eb16e30 tempest-VolumesNegativeTest-1999238818 tempest-VolumesNegativeTest-1999238818-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:50:16.945956 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-8e578cf8-24f3-4dbf-a406-15008eb16e30 tempest-VolumesNegativeTest-1999238818 tempest-VolumesNegativeTest-1999238818-project] [instance: 4652b76e-2f6a-459c-a8f8-0d7badb48e4b] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:50:16.949519 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-9d687df8-4f24-4de4-b492-7a9dc946ae69 tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:50:16.950072 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-9d687df8-4f24-4de4-b492-7a9dc946ae69 tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:50:16.950950 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-9d687df8-4f24-4de4-b492-7a9dc946ae69 tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:50:16.951480 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-9d687df8-4f24-4de4-b492-7a9dc946ae69 tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:50:16.953573 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-8e578cf8-24f3-4dbf-a406-15008eb16e30 tempest-VolumesNegativeTest-1999238818 tempest-VolumesNegativeTest-1999238818-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:50:16.954015 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-8e578cf8-24f3-4dbf-a406-15008eb16e30 tempest-VolumesNegativeTest-1999238818 tempest-VolumesNegativeTest-1999238818-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:50:16.954796 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-8e578cf8-24f3-4dbf-a406-15008eb16e30 tempest-VolumesNegativeTest-1999238818 tempest-VolumesNegativeTest-1999238818-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:50:16.955233 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-8e578cf8-24f3-4dbf-a406-15008eb16e30 tempest-VolumesNegativeTest-1999238818 tempest-VolumesNegativeTest-1999238818-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:50:16.984942 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-9d687df8-4f24-4de4-b492-7a9dc946ae69 tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] 10.222.0.30 "GET /compute/v2.1/servers/12183d8e-4c50-449a-a93d-cee72f597b3d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047835 Dec 24 10:50:16.985684 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 417/824] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Dec 24 10:50:16 2021] GET /compute/v2.1/servers/12183d8e-4c50-449a-a93d-cee72f597b3d/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Dec 24 10:50:16.988610 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-8e578cf8-24f3-4dbf-a406-15008eb16e30 tempest-VolumesNegativeTest-1999238818 tempest-VolumesNegativeTest-1999238818-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:50:16.989086 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-8e578cf8-24f3-4dbf-a406-15008eb16e30 tempest-VolumesNegativeTest-1999238818 tempest-VolumesNegativeTest-1999238818-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:50:16.989536 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.objects.instance [None req-8e578cf8-24f3-4dbf-a406-15008eb16e30 tempest-VolumesNegativeTest-1999238818 tempest-VolumesNegativeTest-1999238818-project] Lazy-loading 'fault' on Instance uuid 4652b76e-2f6a-459c-a8f8-0d7badb48e4b {{(pid=123431) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 24 10:50:16.997313 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-c2047495-beb7-4e51-8ce1-2fb23b0abc2a tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:50:16.997975 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-c2047495-beb7-4e51-8ce1-2fb23b0abc2a tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] [instance: 12183d8e-4c50-449a-a93d-cee72f597b3d] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:50:17.004282 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-c2047495-beb7-4e51-8ce1-2fb23b0abc2a tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:50:17.005004 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-c2047495-beb7-4e51-8ce1-2fb23b0abc2a tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:50:17.006206 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-c2047495-beb7-4e51-8ce1-2fb23b0abc2a tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:50:17.020453 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-c2047495-beb7-4e51-8ce1-2fb23b0abc2a tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:50:17.035509 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-8e578cf8-24f3-4dbf-a406-15008eb16e30 tempest-VolumesNegativeTest-1999238818 tempest-VolumesNegativeTest-1999238818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1388ed800fab47adbe500bc0fa3265a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f6eb4208cd44353b71f263b6ec1aaa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:50:17.043830 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-8e578cf8-24f3-4dbf-a406-15008eb16e30 tempest-VolumesNegativeTest-1999238818 tempest-VolumesNegativeTest-1999238818-project] 10.222.0.30 "GET /compute/v2.1/servers/4652b76e-2f6a-459c-a8f8-0d7badb48e4b" status: 200 len: 1304 microversion: 2.1 time: 0.102705 Dec 24 10:50:17.045164 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 408/825] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:50:16 2021] GET /compute/v2.1/servers/4652b76e-2f6a-459c-a8f8-0d7badb48e4b => generated 1304 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:50:17.079656 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.wsgi [None req-c2047495-beb7-4e51-8ce1-2fb23b0abc2a tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] HTTP exception thrown: Instance 12183d8e-4c50-449a-a93d-cee72f597b3d is not attached to volume 305fd416-40bf-4b2b-b6e9-df2600997549 Dec 24 10:50:17.089056 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-c2047495-beb7-4e51-8ce1-2fb23b0abc2a tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Returning 404 to user: Instance 12183d8e-4c50-449a-a93d-cee72f597b3d is not attached to volume 305fd416-40bf-4b2b-b6e9-df2600997549 {{(pid=123432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 24 10:50:17.089056 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-c2047495-beb7-4e51-8ce1-2fb23b0abc2a tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] 10.222.0.30 "DELETE /compute/v2.1/servers/12183d8e-4c50-449a-a93d-cee72f597b3d/os-volume_attachments/305fd416-40bf-4b2b-b6e9-df2600997549" status: 404 len: 154 microversion: 2.1 time: 0.089799 Dec 24 10:50:17.089056 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 418/826] 10.222.0.30 () {58 vars in 1415 bytes} [Fri Dec 24 10:50:16 2021] DELETE /compute/v2.1/servers/12183d8e-4c50-449a-a93d-cee72f597b3d/os-volume_attachments/305fd416-40bf-4b2b-b6e9-df2600997549 => generated 154 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 24 10:50:17.222369 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-26b9cc03-1e9e-4836-9b7f-9a571cd37215 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:50:17.223193 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-26b9cc03-1e9e-4836-9b7f-9a571cd37215 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] [instance: d2c0f276-f763-4337-a5dd-0c328c8c2e73] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:50:17.230550 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-26b9cc03-1e9e-4836-9b7f-9a571cd37215 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:50:17.230994 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-26b9cc03-1e9e-4836-9b7f-9a571cd37215 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:50:17.231763 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-26b9cc03-1e9e-4836-9b7f-9a571cd37215 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:50:17.232196 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-26b9cc03-1e9e-4836-9b7f-9a571cd37215 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:50:17.288507 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-26b9cc03-1e9e-4836-9b7f-9a571cd37215 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] 10.222.0.30 "POST /compute/v2.1/servers/d2c0f276-f763-4337-a5dd-0c328c8c2e73/action" status: 200 len: 14 microversion: 2.20 time: 0.069740 Dec 24 10:50:17.289215 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 409/827] 10.222.0.30 () {62 vars in 1318 bytes} [Fri Dec 24 10:50:17 2021] POST /compute/v2.1/servers/d2c0f276-f763-4337-a5dd-0c328c8c2e73/action => generated 14 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:50:18.061094 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-14c655d1-cbc3-4aac-8a2d-14450bc1ed39 tempest-VolumesNegativeTest-1999238818 tempest-VolumesNegativeTest-1999238818-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:50:18.061700 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-14c655d1-cbc3-4aac-8a2d-14450bc1ed39 tempest-VolumesNegativeTest-1999238818 tempest-VolumesNegativeTest-1999238818-project] [instance: 4652b76e-2f6a-459c-a8f8-0d7badb48e4b] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:50:18.067909 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-14c655d1-cbc3-4aac-8a2d-14450bc1ed39 tempest-VolumesNegativeTest-1999238818 tempest-VolumesNegativeTest-1999238818-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:50:18.068343 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-14c655d1-cbc3-4aac-8a2d-14450bc1ed39 tempest-VolumesNegativeTest-1999238818 tempest-VolumesNegativeTest-1999238818-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:50:18.070326 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-14c655d1-cbc3-4aac-8a2d-14450bc1ed39 tempest-VolumesNegativeTest-1999238818 tempest-VolumesNegativeTest-1999238818-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:50:18.070326 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-14c655d1-cbc3-4aac-8a2d-14450bc1ed39 tempest-VolumesNegativeTest-1999238818 tempest-VolumesNegativeTest-1999238818-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:50:18.083193 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.wsgi [None req-14c655d1-cbc3-4aac-8a2d-14450bc1ed39 tempest-VolumesNegativeTest-1999238818 tempest-VolumesNegativeTest-1999238818-project] HTTP exception thrown: Instance 4652b76e-2f6a-459c-a8f8-0d7badb48e4b could not be found. Dec 24 10:50:18.083766 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-14c655d1-cbc3-4aac-8a2d-14450bc1ed39 tempest-VolumesNegativeTest-1999238818 tempest-VolumesNegativeTest-1999238818-project] Returning 404 to user: Instance 4652b76e-2f6a-459c-a8f8-0d7badb48e4b could not be found. {{(pid=123432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 24 10:50:18.084561 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-14c655d1-cbc3-4aac-8a2d-14450bc1ed39 tempest-VolumesNegativeTest-1999238818 tempest-VolumesNegativeTest-1999238818-project] 10.222.0.30 "GET /compute/v2.1/servers/4652b76e-2f6a-459c-a8f8-0d7badb48e4b" status: 404 len: 111 microversion: 2.1 time: 0.027791 Dec 24 10:50:18.085111 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 419/828] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:50:18 2021] GET /compute/v2.1/servers/4652b76e-2f6a-459c-a8f8-0d7badb48e4b => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 24 10:50:18.300012 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-dfa74b60-43f6-4b13-9cfc-6a3b1d92a868 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:50:18.301041 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-dfa74b60-43f6-4b13-9cfc-6a3b1d92a868 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] [instance: d2c0f276-f763-4337-a5dd-0c328c8c2e73] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:50:18.308476 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-dfa74b60-43f6-4b13-9cfc-6a3b1d92a868 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:50:18.308950 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-dfa74b60-43f6-4b13-9cfc-6a3b1d92a868 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:50:18.309929 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-dfa74b60-43f6-4b13-9cfc-6a3b1d92a868 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:50:18.310359 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-dfa74b60-43f6-4b13-9cfc-6a3b1d92a868 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:50:18.371582 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-dfa74b60-43f6-4b13-9cfc-6a3b1d92a868 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] 10.222.0.30 "POST /compute/v2.1/servers/d2c0f276-f763-4337-a5dd-0c328c8c2e73/action" status: 200 len: 14 microversion: 2.20 time: 0.074191 Dec 24 10:50:18.375099 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 410/829] 10.222.0.30 () {62 vars in 1318 bytes} [Fri Dec 24 10:50:18 2021] POST /compute/v2.1/servers/d2c0f276-f763-4337-a5dd-0c328c8c2e73/action => generated 14 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:50:18.565704 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-9efbd3fb-183f-4299-b731-c4b732daf451 tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:50:18.566273 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-9efbd3fb-183f-4299-b731-c4b732daf451 tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] [instance: 12183d8e-4c50-449a-a93d-cee72f597b3d] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:50:18.572027 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-9efbd3fb-183f-4299-b731-c4b732daf451 tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:50:18.577580 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-9efbd3fb-183f-4299-b731-c4b732daf451 tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:50:18.577580 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-9efbd3fb-183f-4299-b731-c4b732daf451 tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:50:18.577580 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-9efbd3fb-183f-4299-b731-c4b732daf451 tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:50:18.599124 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-9efbd3fb-183f-4299-b731-c4b732daf451 tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] [instance: 12183d8e-4c50-449a-a93d-cee72f597b3d] Going to try to terminate instance {{(pid=123432) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 24 10:50:19.020704 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-9efbd3fb-183f-4299-b731-c4b732daf451 tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] 10.222.0.30 "DELETE /compute/v2.1/servers/12183d8e-4c50-449a-a93d-cee72f597b3d" status: 204 len: 0 microversion: 2.1 time: 0.458256 Dec 24 10:50:19.021326 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 420/830] 10.222.0.30 () {58 vars in 1238 bytes} [Fri Dec 24 10:50:18 2021] DELETE /compute/v2.1/servers/12183d8e-4c50-449a-a93d-cee72f597b3d => generated 0 bytes in 460 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 24 10:50:19.030500 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-9d2afd5f-cab7-4e92-a175-aa4f4767065e tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:50:19.031220 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-9d2afd5f-cab7-4e92-a175-aa4f4767065e tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] [instance: 12183d8e-4c50-449a-a93d-cee72f597b3d] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:50:19.038020 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-9d2afd5f-cab7-4e92-a175-aa4f4767065e tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:50:19.038465 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-9d2afd5f-cab7-4e92-a175-aa4f4767065e tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:50:19.039232 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-9d2afd5f-cab7-4e92-a175-aa4f4767065e tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:50:19.039694 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-9d2afd5f-cab7-4e92-a175-aa4f4767065e tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:50:19.174285 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-9d2afd5f-cab7-4e92-a175-aa4f4767065e tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e2194bc8c0d44b186956c1b38a0c04a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed29a38d2fe424398ac10e585a980df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:50:19.181958 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-9d2afd5f-cab7-4e92-a175-aa4f4767065e tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] 10.222.0.30 "GET /compute/v2.1/servers/12183d8e-4c50-449a-a93d-cee72f597b3d" status: 200 len: 1554 microversion: 2.1 time: 0.155972 Dec 24 10:50:19.188416 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 411/831] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:50:19 2021] GET /compute/v2.1/servers/12183d8e-4c50-449a-a93d-cee72f597b3d => generated 1554 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:50:19.382705 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-0d496fa5-e30b-49cb-b80b-48e413b53d19 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:50:19.383803 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-0d496fa5-e30b-49cb-b80b-48e413b53d19 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] [instance: d2c0f276-f763-4337-a5dd-0c328c8c2e73] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:50:19.391198 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-0d496fa5-e30b-49cb-b80b-48e413b53d19 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:50:19.391890 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-0d496fa5-e30b-49cb-b80b-48e413b53d19 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:50:19.392759 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-0d496fa5-e30b-49cb-b80b-48e413b53d19 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:50:19.393617 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-0d496fa5-e30b-49cb-b80b-48e413b53d19 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:50:19.454054 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-0d496fa5-e30b-49cb-b80b-48e413b53d19 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] 10.222.0.30 "POST /compute/v2.1/servers/d2c0f276-f763-4337-a5dd-0c328c8c2e73/action" status: 200 len: 14 microversion: 2.20 time: 0.075281 Dec 24 10:50:19.457350 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 421/832] 10.222.0.30 () {62 vars in 1318 bytes} [Fri Dec 24 10:50:19 2021] POST /compute/v2.1/servers/d2c0f276-f763-4337-a5dd-0c328c8c2e73/action => generated 14 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:50:20.210729 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-da181e6b-e6b7-474c-8670-defd2cce6383 tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:50:20.211339 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-da181e6b-e6b7-474c-8670-defd2cce6383 tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] [instance: 12183d8e-4c50-449a-a93d-cee72f597b3d] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:50:20.217707 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-da181e6b-e6b7-474c-8670-defd2cce6383 tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:50:20.218138 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-da181e6b-e6b7-474c-8670-defd2cce6383 tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:50:20.218926 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-da181e6b-e6b7-474c-8670-defd2cce6383 tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:50:20.219362 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-da181e6b-e6b7-474c-8670-defd2cce6383 tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:50:20.369858 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-da181e6b-e6b7-474c-8670-defd2cce6383 tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e2194bc8c0d44b186956c1b38a0c04a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed29a38d2fe424398ac10e585a980df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:50:20.377711 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-da181e6b-e6b7-474c-8670-defd2cce6383 tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] 10.222.0.30 "GET /compute/v2.1/servers/12183d8e-4c50-449a-a93d-cee72f597b3d" status: 200 len: 1554 microversion: 2.1 time: 0.170603 Dec 24 10:50:20.378273 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 412/833] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:50:20 2021] GET /compute/v2.1/servers/12183d8e-4c50-449a-a93d-cee72f597b3d => generated 1554 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:50:20.465053 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-3a645fa4-7892-44e0-b8f9-d39c9e4baf19 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:50:20.465984 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-3a645fa4-7892-44e0-b8f9-d39c9e4baf19 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] [instance: d2c0f276-f763-4337-a5dd-0c328c8c2e73] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:50:20.472749 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-3a645fa4-7892-44e0-b8f9-d39c9e4baf19 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:50:20.473221 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-3a645fa4-7892-44e0-b8f9-d39c9e4baf19 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:50:20.473998 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-3a645fa4-7892-44e0-b8f9-d39c9e4baf19 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:50:20.474463 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-3a645fa4-7892-44e0-b8f9-d39c9e4baf19 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:50:20.537071 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-3a645fa4-7892-44e0-b8f9-d39c9e4baf19 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] 10.222.0.30 "POST /compute/v2.1/servers/d2c0f276-f763-4337-a5dd-0c328c8c2e73/action" status: 200 len: 14 microversion: 2.20 time: 0.075950 Dec 24 10:50:20.537716 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 422/834] 10.222.0.30 () {62 vars in 1318 bytes} [Fri Dec 24 10:50:20 2021] POST /compute/v2.1/servers/d2c0f276-f763-4337-a5dd-0c328c8c2e73/action => generated 14 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:50:21.394948 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-2fce233a-1b93-4403-a81c-63693809eb48 tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:50:21.395678 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-2fce233a-1b93-4403-a81c-63693809eb48 tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] [instance: 12183d8e-4c50-449a-a93d-cee72f597b3d] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:50:21.403471 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-2fce233a-1b93-4403-a81c-63693809eb48 tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:50:21.404071 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-2fce233a-1b93-4403-a81c-63693809eb48 tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:50:21.404745 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-2fce233a-1b93-4403-a81c-63693809eb48 tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:50:21.405165 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-2fce233a-1b93-4403-a81c-63693809eb48 tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:50:21.549568 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-bc7745d8-6cb6-4d68-9978-e99f6e824d96 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:50:21.555216 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-bc7745d8-6cb6-4d68-9978-e99f6e824d96 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] [instance: d2c0f276-f763-4337-a5dd-0c328c8c2e73] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:50:21.562569 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-bc7745d8-6cb6-4d68-9978-e99f6e824d96 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:50:21.565153 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-bc7745d8-6cb6-4d68-9978-e99f6e824d96 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:50:21.566667 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-bc7745d8-6cb6-4d68-9978-e99f6e824d96 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:50:21.567501 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-bc7745d8-6cb6-4d68-9978-e99f6e824d96 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:50:21.647698 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-bc7745d8-6cb6-4d68-9978-e99f6e824d96 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] 10.222.0.30 "POST /compute/v2.1/servers/d2c0f276-f763-4337-a5dd-0c328c8c2e73/action" status: 200 len: 14 microversion: 2.20 time: 0.102616 Dec 24 10:50:21.652480 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 423/835] 10.222.0.30 () {62 vars in 1318 bytes} [Fri Dec 24 10:50:21 2021] POST /compute/v2.1/servers/d2c0f276-f763-4337-a5dd-0c328c8c2e73/action => generated 14 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:50:21.771622 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-2fce233a-1b93-4403-a81c-63693809eb48 tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e2194bc8c0d44b186956c1b38a0c04a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed29a38d2fe424398ac10e585a980df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:50:21.780945 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-2fce233a-1b93-4403-a81c-63693809eb48 tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] 10.222.0.30 "GET /compute/v2.1/servers/12183d8e-4c50-449a-a93d-cee72f597b3d" status: 200 len: 1512 microversion: 2.1 time: 0.389819 Dec 24 10:50:21.781856 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 413/836] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:50:21 2021] GET /compute/v2.1/servers/12183d8e-4c50-449a-a93d-cee72f597b3d => generated 1512 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:50:22.025561 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [req-1b3fa4cb-4cb1-4ffb-ab0e-e8bbae293860 req-e7594e18-a4b2-481b-bbd7-e912f5cbf28e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "12183d8e-4c50-449a-a93d-cee72f597b3d", "name": "network-vif-deleted", "tag": "abebf56e-a643-48ae-a779-897dbd105170"}]} {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:50:22.027856 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 10:50:22.027856 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: warnings.warn(msg) Dec 24 10:50:22.035423 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [req-1b3fa4cb-4cb1-4ffb-ab0e-e8bbae293860 req-e7594e18-a4b2-481b-bbd7-e912f5cbf28e service nova] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:50:22.039922 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [req-1b3fa4cb-4cb1-4ffb-ab0e-e8bbae293860 req-e7594e18-a4b2-481b-bbd7-e912f5cbf28e service nova] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:50:22.046167 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.compute.server_external_events [req-1b3fa4cb-4cb1-4ffb-ab0e-e8bbae293860 req-e7594e18-a4b2-481b-bbd7-e912f5cbf28e service nova] Creating event network-vif-deleted:abebf56e-a643-48ae-a779-897dbd105170 for instance 12183d8e-4c50-449a-a93d-cee72f597b3d on hv-cinder-81644 Dec 24 10:50:22.050884 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [req-1b3fa4cb-4cb1-4ffb-ab0e-e8bbae293860 req-e7594e18-a4b2-481b-bbd7-e912f5cbf28e service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.299710 Dec 24 10:50:22.051622 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 424/837] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Dec 24 10:50:21 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 24 10:50:22.658614 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-696e744a-439e-41fb-bb5d-1f65e42f5a9c tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:50:22.660172 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-696e744a-439e-41fb-bb5d-1f65e42f5a9c tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] [instance: d2c0f276-f763-4337-a5dd-0c328c8c2e73] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:50:22.666234 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-696e744a-439e-41fb-bb5d-1f65e42f5a9c tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:50:22.666679 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-696e744a-439e-41fb-bb5d-1f65e42f5a9c tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:50:22.667454 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-696e744a-439e-41fb-bb5d-1f65e42f5a9c tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:50:22.667885 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-696e744a-439e-41fb-bb5d-1f65e42f5a9c tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:50:22.732014 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-696e744a-439e-41fb-bb5d-1f65e42f5a9c tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] 10.222.0.30 "POST /compute/v2.1/servers/d2c0f276-f763-4337-a5dd-0c328c8c2e73/action" status: 200 len: 14 microversion: 2.20 time: 0.076732 Dec 24 10:50:22.732850 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 414/838] 10.222.0.30 () {62 vars in 1318 bytes} [Fri Dec 24 10:50:22 2021] POST /compute/v2.1/servers/d2c0f276-f763-4337-a5dd-0c328c8c2e73/action => generated 14 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:50:22.799077 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-d89acd87-6de0-481a-bab9-fb18e55b5e3d tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:50:22.799838 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-d89acd87-6de0-481a-bab9-fb18e55b5e3d tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] [instance: 12183d8e-4c50-449a-a93d-cee72f597b3d] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:50:22.805879 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-d89acd87-6de0-481a-bab9-fb18e55b5e3d tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:50:22.806324 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-d89acd87-6de0-481a-bab9-fb18e55b5e3d tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:50:22.807096 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-d89acd87-6de0-481a-bab9-fb18e55b5e3d tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:50:22.807573 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-d89acd87-6de0-481a-bab9-fb18e55b5e3d tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:50:22.840587 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-d89acd87-6de0-481a-bab9-fb18e55b5e3d tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:50:22.841064 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-d89acd87-6de0-481a-bab9-fb18e55b5e3d tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:50:22.841517 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.objects.instance [None req-d89acd87-6de0-481a-bab9-fb18e55b5e3d tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Lazy-loading 'fault' on Instance uuid 12183d8e-4c50-449a-a93d-cee72f597b3d {{(pid=123432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 24 10:50:22.884168 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-d89acd87-6de0-481a-bab9-fb18e55b5e3d tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e2194bc8c0d44b186956c1b38a0c04a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed29a38d2fe424398ac10e585a980df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:50:22.891522 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-d89acd87-6de0-481a-bab9-fb18e55b5e3d tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] 10.222.0.30 "GET /compute/v2.1/servers/12183d8e-4c50-449a-a93d-cee72f597b3d" status: 200 len: 1349 microversion: 2.1 time: 0.096939 Dec 24 10:50:22.892114 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 425/839] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:50:22 2021] GET /compute/v2.1/servers/12183d8e-4c50-449a-a93d-cee72f597b3d => generated 1349 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:50:23.744635 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-dc204ad6-5de3-417e-91ab-246822a58bbd tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:50:23.746607 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-dc204ad6-5de3-417e-91ab-246822a58bbd tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] [instance: d2c0f276-f763-4337-a5dd-0c328c8c2e73] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:50:23.753760 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-dc204ad6-5de3-417e-91ab-246822a58bbd tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:50:23.755543 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-dc204ad6-5de3-417e-91ab-246822a58bbd tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:50:23.755543 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-dc204ad6-5de3-417e-91ab-246822a58bbd tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:50:23.755543 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-dc204ad6-5de3-417e-91ab-246822a58bbd tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:50:23.831015 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-dc204ad6-5de3-417e-91ab-246822a58bbd tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] 10.222.0.30 "POST /compute/v2.1/servers/d2c0f276-f763-4337-a5dd-0c328c8c2e73/action" status: 200 len: 8481 microversion: 2.20 time: 0.091118 Dec 24 10:50:23.831588 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 415/840] 10.222.0.30 () {62 vars in 1318 bytes} [Fri Dec 24 10:50:23 2021] POST /compute/v2.1/servers/d2c0f276-f763-4337-a5dd-0c328c8c2e73/action => generated 8481 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 10:50:23.908939 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-39bbbafa-44bd-4709-b2b7-706015c02b3f tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:50:23.909551 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-39bbbafa-44bd-4709-b2b7-706015c02b3f tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] [instance: 12183d8e-4c50-449a-a93d-cee72f597b3d] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:50:23.915707 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-39bbbafa-44bd-4709-b2b7-706015c02b3f tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:50:23.916158 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-39bbbafa-44bd-4709-b2b7-706015c02b3f tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:50:23.917009 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-39bbbafa-44bd-4709-b2b7-706015c02b3f tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:50:23.921789 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-39bbbafa-44bd-4709-b2b7-706015c02b3f tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:50:23.931007 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.wsgi [None req-39bbbafa-44bd-4709-b2b7-706015c02b3f tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] HTTP exception thrown: Instance 12183d8e-4c50-449a-a93d-cee72f597b3d could not be found. Dec 24 10:50:23.931594 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-39bbbafa-44bd-4709-b2b7-706015c02b3f tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Returning 404 to user: Instance 12183d8e-4c50-449a-a93d-cee72f597b3d could not be found. {{(pid=123432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 24 10:50:23.932415 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-39bbbafa-44bd-4709-b2b7-706015c02b3f tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] 10.222.0.30 "GET /compute/v2.1/servers/12183d8e-4c50-449a-a93d-cee72f597b3d" status: 404 len: 111 microversion: 2.1 time: 0.027230 Dec 24 10:50:23.933237 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 426/841] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:50:23 2021] GET /compute/v2.1/servers/12183d8e-4c50-449a-a93d-cee72f597b3d => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 24 10:50:23.941790 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-db0a0548-560a-4b02-a73f-27a726320a83 tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] Calling method '.version_select at 0x7f1899a87f70>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:50:24.229073 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-db0a0548-560a-4b02-a73f-27a726320a83 tempest-TestMinimumBasicScenario-7174661 tempest-TestMinimumBasicScenario-7174661-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1333698510" status: 202 len: 0 microversion: 2.1 time: 0.291197 Dec 24 10:50:24.229665 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 416/842] 10.222.0.30 () {58 vars in 1271 bytes} [Fri Dec 24 10:50:23 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1333698510 => generated 0 bytes in 293 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 24 10:50:24.842227 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-65d60428-fa64-4cd2-a638-b2e3597c3474 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:50:24.843111 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-65d60428-fa64-4cd2-a638-b2e3597c3474 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] [instance: d2c0f276-f763-4337-a5dd-0c328c8c2e73] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:50:24.849021 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-65d60428-fa64-4cd2-a638-b2e3597c3474 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:50:24.849475 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-65d60428-fa64-4cd2-a638-b2e3597c3474 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:50:24.850281 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-65d60428-fa64-4cd2-a638-b2e3597c3474 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:50:24.850711 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-65d60428-fa64-4cd2-a638-b2e3597c3474 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:50:24.922919 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-65d60428-fa64-4cd2-a638-b2e3597c3474 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] 10.222.0.30 "POST /compute/v2.1/servers/d2c0f276-f763-4337-a5dd-0c328c8c2e73/action" status: 200 len: 15942 microversion: 2.20 time: 0.084386 Dec 24 10:50:24.923778 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 427/843] 10.222.0.30 () {62 vars in 1318 bytes} [Fri Dec 24 10:50:24 2021] POST /compute/v2.1/servers/d2c0f276-f763-4337-a5dd-0c328c8c2e73/action => generated 15942 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 24 10:50:25.934399 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-8cbf4417-4579-423c-a0dd-3a01150b264f tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:50:25.935360 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-8cbf4417-4579-423c-a0dd-3a01150b264f tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] [instance: d2c0f276-f763-4337-a5dd-0c328c8c2e73] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:50:25.941765 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-8cbf4417-4579-423c-a0dd-3a01150b264f tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:50:25.942206 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-8cbf4417-4579-423c-a0dd-3a01150b264f tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:50:25.942964 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-8cbf4417-4579-423c-a0dd-3a01150b264f tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:50:25.943391 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-8cbf4417-4579-423c-a0dd-3a01150b264f tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:50:26.025234 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-8cbf4417-4579-423c-a0dd-3a01150b264f tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] 10.222.0.30 "POST /compute/v2.1/servers/d2c0f276-f763-4337-a5dd-0c328c8c2e73/action" status: 200 len: 18449 microversion: 2.20 time: 0.094460 Dec 24 10:50:26.025884 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 417/844] 10.222.0.30 () {62 vars in 1318 bytes} [Fri Dec 24 10:50:25 2021] POST /compute/v2.1/servers/d2c0f276-f763-4337-a5dd-0c328c8c2e73/action => generated 18449 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 24 10:50:26.418799 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-17be4c0f-b7ea-4397-8c46-ad8ab5f185f5 tempest-VolumesActionsTest-1489615802 tempest-VolumesActionsTest-1489615802-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-368279358", "imageRef": "fae8172d-77c4-4f40-905a-7285c185448c", "flavorRef": "452", "networks": [{"uuid": "76ae600f-f994-44b0-af72-4c73bd837846"}]}} {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:50:26.476596 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.network.neutron [None req-17be4c0f-b7ea-4397-8c46-ad8ab5f185f5 tempest-VolumesActionsTest-1489615802 tempest-VolumesActionsTest-1489615802-project] validate_networks() for [('76ae600f-f994-44b0-af72-4c73bd837846', None, None, None, None, None)] {{(pid=123432) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 24 10:50:27.037647 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-77494689-7d3b-49b3-ac49-cbe65134fee5 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:50:27.038804 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-77494689-7d3b-49b3-ac49-cbe65134fee5 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] [instance: d2c0f276-f763-4337-a5dd-0c328c8c2e73] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:50:27.046323 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-77494689-7d3b-49b3-ac49-cbe65134fee5 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:50:27.046764 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-77494689-7d3b-49b3-ac49-cbe65134fee5 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:50:27.047602 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-77494689-7d3b-49b3-ac49-cbe65134fee5 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:50:27.048036 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-77494689-7d3b-49b3-ac49-cbe65134fee5 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:50:27.126898 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-77494689-7d3b-49b3-ac49-cbe65134fee5 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] 10.222.0.30 "POST /compute/v2.1/servers/d2c0f276-f763-4337-a5dd-0c328c8c2e73/action" status: 200 len: 19774 microversion: 2.20 time: 0.093204 Dec 24 10:50:27.128301 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 418/845] 10.222.0.30 () {62 vars in 1318 bytes} [Fri Dec 24 10:50:27 2021] POST /compute/v2.1/servers/d2c0f276-f763-4337-a5dd-0c328c8c2e73/action => generated 19774 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 24 10:50:27.196469 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.virt.hardware [None req-17be4c0f-b7ea-4397-8c46-ad8ab5f185f5 tempest-VolumesActionsTest-1489615802 tempest-VolumesActionsTest-1489615802-project] Flavor limits 0:0:0 {{(pid=123432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 24 10:50:27.196922 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.virt.hardware [None req-17be4c0f-b7ea-4397-8c46-ad8ab5f185f5 tempest-VolumesActionsTest-1489615802 tempest-VolumesActionsTest-1489615802-project] Image limits 0:0:0 {{(pid=123432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 24 10:50:27.197403 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.virt.hardware [None req-17be4c0f-b7ea-4397-8c46-ad8ab5f185f5 tempest-VolumesActionsTest-1489615802 tempest-VolumesActionsTest-1489615802-project] Flavor pref 0:0:0 {{(pid=123432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 24 10:50:27.197811 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.virt.hardware [None req-17be4c0f-b7ea-4397-8c46-ad8ab5f185f5 tempest-VolumesActionsTest-1489615802 tempest-VolumesActionsTest-1489615802-project] Image pref 0:0:0 {{(pid=123432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 24 10:50:27.198231 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.virt.hardware [None req-17be4c0f-b7ea-4397-8c46-ad8ab5f185f5 tempest-VolumesActionsTest-1489615802 tempest-VolumesActionsTest-1489615802-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 24 10:50:27.207401 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-17be4c0f-b7ea-4397-8c46-ad8ab5f185f5 tempest-VolumesActionsTest-1489615802 tempest-VolumesActionsTest-1489615802-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:50:27.207938 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-17be4c0f-b7ea-4397-8c46-ad8ab5f185f5 tempest-VolumesActionsTest-1489615802 tempest-VolumesActionsTest-1489615802-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:50:27.208678 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-17be4c0f-b7ea-4397-8c46-ad8ab5f185f5 tempest-VolumesActionsTest-1489615802 tempest-VolumesActionsTest-1489615802-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:50:27.209152 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-17be4c0f-b7ea-4397-8c46-ad8ab5f185f5 tempest-VolumesActionsTest-1489615802 tempest-VolumesActionsTest-1489615802-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:50:27.226443 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.quota [None req-17be4c0f-b7ea-4397-8c46-ad8ab5f185f5 tempest-VolumesActionsTest-1489615802 tempest-VolumesActionsTest-1489615802-project] Getting quotas for project 2c8a5fd5e33e4d059b152730ca60d5c9. Resources: {'instances', 'cores', 'ram'} {{(pid=123432) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 24 10:50:27.230477 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.quota [None req-17be4c0f-b7ea-4397-8c46-ad8ab5f185f5 tempest-VolumesActionsTest-1489615802 tempest-VolumesActionsTest-1489615802-project] Getting quotas for user b484152f59664123bf8c9d4c56bfebb6 and project 2c8a5fd5e33e4d059b152730ca60d5c9. Resources: {'instances', 'cores', 'ram'} {{(pid=123432) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 24 10:50:27.241898 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-17be4c0f-b7ea-4397-8c46-ad8ab5f185f5 tempest-VolumesActionsTest-1489615802 tempest-VolumesActionsTest-1489615802-project] Going to run 1 instances... {{(pid=123432) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 24 10:50:27.244315 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-17be4c0f-b7ea-4397-8c46-ad8ab5f185f5 tempest-VolumesActionsTest-1489615802 tempest-VolumesActionsTest-1489615802-project] [instance: e948b5ed-a647-4111-833a-61931190c520] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fae8172d-77c4-4f40-905a-7285c185448c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123432) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 24 10:50:27.376633 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-17be4c0f-b7ea-4397-8c46-ad8ab5f185f5 tempest-VolumesActionsTest-1489615802 tempest-VolumesActionsTest-1489615802-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.961502 Dec 24 10:50:27.384632 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 428/846] 10.222.0.30 () {60 vars in 1146 bytes} [Fri Dec 24 10:50:26 2021] POST /compute/v2.1/servers => generated 380 bytes in 971 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 24 10:50:27.388649 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-a056a568-57a3-48a9-9c12-01eb945ad180 tempest-VolumesActionsTest-1489615802 tempest-VolumesActionsTest-1489615802-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:50:27.389670 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-a056a568-57a3-48a9-9c12-01eb945ad180 tempest-VolumesActionsTest-1489615802 tempest-VolumesActionsTest-1489615802-project] [instance: e948b5ed-a647-4111-833a-61931190c520] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:50:27.465215 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-a056a568-57a3-48a9-9c12-01eb945ad180 tempest-VolumesActionsTest-1489615802 tempest-VolumesActionsTest-1489615802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b484152f59664123bf8c9d4c56bfebb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8a5fd5e33e4d059b152730ca60d5c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:50:27.472891 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-a056a568-57a3-48a9-9c12-01eb945ad180 tempest-VolumesActionsTest-1489615802 tempest-VolumesActionsTest-1489615802-project] 10.222.0.30 "GET /compute/v2.1/servers/e948b5ed-a647-4111-833a-61931190c520" status: 200 len: 1213 microversion: 2.1 time: 0.088717 Dec 24 10:50:27.473632 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 419/847] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:50:27 2021] GET /compute/v2.1/servers/e948b5ed-a647-4111-833a-61931190c520 => generated 1213 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:50:28.140001 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-22e141b8-602e-4fc0-a685-6599718ac431 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:50:28.142019 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-22e141b8-602e-4fc0-a685-6599718ac431 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] [instance: d2c0f276-f763-4337-a5dd-0c328c8c2e73] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:50:28.150407 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-22e141b8-602e-4fc0-a685-6599718ac431 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:50:28.151025 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-22e141b8-602e-4fc0-a685-6599718ac431 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:50:28.152025 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-22e141b8-602e-4fc0-a685-6599718ac431 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:50:28.155400 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-22e141b8-602e-4fc0-a685-6599718ac431 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:50:28.232718 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-22e141b8-602e-4fc0-a685-6599718ac431 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] 10.222.0.30 "POST /compute/v2.1/servers/d2c0f276-f763-4337-a5dd-0c328c8c2e73/action" status: 200 len: 22488 microversion: 2.20 time: 0.096790 Dec 24 10:50:28.234194 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 429/848] 10.222.0.30 () {62 vars in 1318 bytes} [Fri Dec 24 10:50:28 2021] POST /compute/v2.1/servers/d2c0f276-f763-4337-a5dd-0c328c8c2e73/action => generated 22488 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 24 10:50:28.491761 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-6e70ed9c-81d7-4170-aaaa-00846789e225 tempest-VolumesActionsTest-1489615802 tempest-VolumesActionsTest-1489615802-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:50:28.492369 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-6e70ed9c-81d7-4170-aaaa-00846789e225 tempest-VolumesActionsTest-1489615802 tempest-VolumesActionsTest-1489615802-project] [instance: e948b5ed-a647-4111-833a-61931190c520] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:50:28.564875 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-6e70ed9c-81d7-4170-aaaa-00846789e225 tempest-VolumesActionsTest-1489615802 tempest-VolumesActionsTest-1489615802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b484152f59664123bf8c9d4c56bfebb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8a5fd5e33e4d059b152730ca60d5c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:50:28.586650 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-6e70ed9c-81d7-4170-aaaa-00846789e225 tempest-VolumesActionsTest-1489615802 tempest-VolumesActionsTest-1489615802-project] 10.222.0.30 "GET /compute/v2.1/servers/e948b5ed-a647-4111-833a-61931190c520" status: 200 len: 1213 microversion: 2.1 time: 0.099503 Dec 24 10:50:28.596967 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 420/849] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:50:28 2021] GET /compute/v2.1/servers/e948b5ed-a647-4111-833a-61931190c520 => generated 1213 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:50:29.244687 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-b9be90b3-dc7e-4138-ab82-adc1b61b3297 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:50:29.246236 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-b9be90b3-dc7e-4138-ab82-adc1b61b3297 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] [instance: d2c0f276-f763-4337-a5dd-0c328c8c2e73] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:50:29.253039 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-b9be90b3-dc7e-4138-ab82-adc1b61b3297 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:50:29.253489 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-b9be90b3-dc7e-4138-ab82-adc1b61b3297 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:50:29.254287 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-b9be90b3-dc7e-4138-ab82-adc1b61b3297 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:50:29.254714 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-b9be90b3-dc7e-4138-ab82-adc1b61b3297 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:50:29.332265 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-b9be90b3-dc7e-4138-ab82-adc1b61b3297 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] 10.222.0.30 "POST /compute/v2.1/servers/d2c0f276-f763-4337-a5dd-0c328c8c2e73/action" status: 200 len: 23798 microversion: 2.20 time: 0.091321 Dec 24 10:50:29.333002 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 430/850] 10.222.0.30 () {62 vars in 1318 bytes} [Fri Dec 24 10:50:29 2021] POST /compute/v2.1/servers/d2c0f276-f763-4337-a5dd-0c328c8c2e73/action => generated 23798 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 24 10:50:29.604061 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-ddc7218b-6d72-4ffe-aedf-e5469fe1c49b tempest-VolumesActionsTest-1489615802 tempest-VolumesActionsTest-1489615802-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:50:29.604669 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-ddc7218b-6d72-4ffe-aedf-e5469fe1c49b tempest-VolumesActionsTest-1489615802 tempest-VolumesActionsTest-1489615802-project] [instance: e948b5ed-a647-4111-833a-61931190c520] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:50:29.614603 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-ddc7218b-6d72-4ffe-aedf-e5469fe1c49b tempest-VolumesActionsTest-1489615802 tempest-VolumesActionsTest-1489615802-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:50:29.618872 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-ddc7218b-6d72-4ffe-aedf-e5469fe1c49b tempest-VolumesActionsTest-1489615802 tempest-VolumesActionsTest-1489615802-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:50:29.618872 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-ddc7218b-6d72-4ffe-aedf-e5469fe1c49b tempest-VolumesActionsTest-1489615802 tempest-VolumesActionsTest-1489615802-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:50:29.618872 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-ddc7218b-6d72-4ffe-aedf-e5469fe1c49b tempest-VolumesActionsTest-1489615802 tempest-VolumesActionsTest-1489615802-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:50:29.696069 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-ddc7218b-6d72-4ffe-aedf-e5469fe1c49b tempest-VolumesActionsTest-1489615802 tempest-VolumesActionsTest-1489615802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b484152f59664123bf8c9d4c56bfebb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8a5fd5e33e4d059b152730ca60d5c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:50:29.703476 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-ddc7218b-6d72-4ffe-aedf-e5469fe1c49b tempest-VolumesActionsTest-1489615802 tempest-VolumesActionsTest-1489615802-project] 10.222.0.30 "GET /compute/v2.1/servers/e948b5ed-a647-4111-833a-61931190c520" status: 200 len: 1265 microversion: 2.1 time: 0.103170 Dec 24 10:50:29.704061 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 421/851] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:50:29 2021] GET /compute/v2.1/servers/e948b5ed-a647-4111-833a-61931190c520 => generated 1265 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:50:30.297103 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-32f34ddd-7975-4dab-864e-b56a2413d1ba tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-204175080", "imageRef": "fae8172d-77c4-4f40-905a-7285c185448c", "flavorRef": "452", "networks": [{"uuid": "d6398a4c-0879-44d1-a22a-b560c11704a8"}]}} {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:50:30.345177 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-327daaa1-18ad-4b6e-ac87-cccbb45ed949 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:50:30.346294 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-327daaa1-18ad-4b6e-ac87-cccbb45ed949 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] [instance: d2c0f276-f763-4337-a5dd-0c328c8c2e73] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:50:30.357458 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-327daaa1-18ad-4b6e-ac87-cccbb45ed949 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:50:30.358121 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-327daaa1-18ad-4b6e-ac87-cccbb45ed949 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:50:30.359074 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-327daaa1-18ad-4b6e-ac87-cccbb45ed949 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:50:30.359605 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.network.neutron [None req-32f34ddd-7975-4dab-864e-b56a2413d1ba tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] validate_networks() for [('d6398a4c-0879-44d1-a22a-b560c11704a8', None, None, None, None, None)] {{(pid=123432) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 24 10:50:30.359885 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-327daaa1-18ad-4b6e-ac87-cccbb45ed949 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:50:30.440614 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-327daaa1-18ad-4b6e-ac87-cccbb45ed949 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] 10.222.0.30 "POST /compute/v2.1/servers/d2c0f276-f763-4337-a5dd-0c328c8c2e73/action" status: 200 len: 25375 microversion: 2.20 time: 0.099648 Dec 24 10:50:30.441302 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 422/852] 10.222.0.30 () {62 vars in 1318 bytes} [Fri Dec 24 10:50:30 2021] POST /compute/v2.1/servers/d2c0f276-f763-4337-a5dd-0c328c8c2e73/action => generated 25375 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 24 10:50:30.632766 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-fa4b5af4-3714-41ac-983f-27981004fa91 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:50:30.743797 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-fa4b5af4-3714-41ac-983f-27981004fa91 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] [instance: 9330dbb8-edad-4d54-afeb-8badc464250d] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:50:30.743797 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-fa4b5af4-3714-41ac-983f-27981004fa91 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:50:30.743797 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-fa4b5af4-3714-41ac-983f-27981004fa91 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:50:30.743797 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-fa4b5af4-3714-41ac-983f-27981004fa91 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:50:30.746041 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-fa4b5af4-3714-41ac-983f-27981004fa91 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:50:30.746041 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-fa4b5af4-3714-41ac-983f-27981004fa91 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] 10.222.0.30 "GET /compute/v2.1/servers/9330dbb8-edad-4d54-afeb-8badc464250d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.057792 Dec 24 10:50:30.746041 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 423/853] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Dec 24 10:50:30 2021] GET /compute/v2.1/servers/9330dbb8-edad-4d54-afeb-8badc464250d/os-volume_attachments => generated 25 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 24 10:50:30.746041 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-174f019d-50de-49e1-ac4c-28e8dbf02a85 tempest-VolumesActionsTest-1489615802 tempest-VolumesActionsTest-1489615802-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:50:30.746041 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-174f019d-50de-49e1-ac4c-28e8dbf02a85 tempest-VolumesActionsTest-1489615802 tempest-VolumesActionsTest-1489615802-project] [instance: e948b5ed-a647-4111-833a-61931190c520] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:50:30.746802 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-174f019d-50de-49e1-ac4c-28e8dbf02a85 tempest-VolumesActionsTest-1489615802 tempest-VolumesActionsTest-1489615802-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:50:30.746802 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-174f019d-50de-49e1-ac4c-28e8dbf02a85 tempest-VolumesActionsTest-1489615802 tempest-VolumesActionsTest-1489615802-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:50:30.746802 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-174f019d-50de-49e1-ac4c-28e8dbf02a85 tempest-VolumesActionsTest-1489615802 tempest-VolumesActionsTest-1489615802-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:50:30.746802 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-174f019d-50de-49e1-ac4c-28e8dbf02a85 tempest-VolumesActionsTest-1489615802 tempest-VolumesActionsTest-1489615802-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:50:30.788626 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.virt.hardware [None req-32f34ddd-7975-4dab-864e-b56a2413d1ba tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] Flavor limits 0:0:0 {{(pid=123432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 24 10:50:30.788878 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.virt.hardware [None req-32f34ddd-7975-4dab-864e-b56a2413d1ba tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] Image limits 0:0:0 {{(pid=123432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 24 10:50:30.789439 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.virt.hardware [None req-32f34ddd-7975-4dab-864e-b56a2413d1ba tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] Flavor pref 0:0:0 {{(pid=123432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 24 10:50:30.789851 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.virt.hardware [None req-32f34ddd-7975-4dab-864e-b56a2413d1ba tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] Image pref 0:0:0 {{(pid=123432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 24 10:50:30.790255 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.virt.hardware [None req-32f34ddd-7975-4dab-864e-b56a2413d1ba tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 24 10:50:30.801471 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-32f34ddd-7975-4dab-864e-b56a2413d1ba tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:50:30.801927 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-32f34ddd-7975-4dab-864e-b56a2413d1ba tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:50:30.802740 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-32f34ddd-7975-4dab-864e-b56a2413d1ba tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:50:30.803220 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-32f34ddd-7975-4dab-864e-b56a2413d1ba tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:50:30.820446 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.quota [None req-32f34ddd-7975-4dab-864e-b56a2413d1ba tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] Getting quotas for project 696f3d18f3af4e0eb5760d829e0c3977. Resources: {'instances', 'cores', 'ram'} {{(pid=123432) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 24 10:50:30.857764 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.quota [None req-32f34ddd-7975-4dab-864e-b56a2413d1ba tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] Getting quotas for user edc441b6f06b44beb2a85f854cf92dd3 and project 696f3d18f3af4e0eb5760d829e0c3977. Resources: {'instances', 'cores', 'ram'} {{(pid=123432) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 24 10:50:30.857764 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-32f34ddd-7975-4dab-864e-b56a2413d1ba tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] Going to run 1 instances... {{(pid=123432) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 24 10:50:30.857764 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-32f34ddd-7975-4dab-864e-b56a2413d1ba tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] [instance: 90bed19f-dc1d-408e-8520-34e390ac92cd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fae8172d-77c4-4f40-905a-7285c185448c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123432) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 24 10:50:30.858806 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-174f019d-50de-49e1-ac4c-28e8dbf02a85 tempest-VolumesActionsTest-1489615802 tempest-VolumesActionsTest-1489615802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b484152f59664123bf8c9d4c56bfebb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8a5fd5e33e4d059b152730ca60d5c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:50:30.864421 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-174f019d-50de-49e1-ac4c-28e8dbf02a85 tempest-VolumesActionsTest-1489615802 tempest-VolumesActionsTest-1489615802-project] 10.222.0.30 "GET /compute/v2.1/servers/e948b5ed-a647-4111-833a-61931190c520" status: 200 len: 1283 microversion: 2.1 time: 0.148219 Dec 24 10:50:30.864955 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 424/854] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:50:30 2021] GET /compute/v2.1/servers/e948b5ed-a647-4111-833a-61931190c520 => generated 1283 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 24 10:50:30.869141 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-a71923a5-7a58-4d38-a7d1-ccdffa448568 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:50:30.869629 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-a71923a5-7a58-4d38-a7d1-ccdffa448568 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] [instance: 9330dbb8-edad-4d54-afeb-8badc464250d] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:50:30.875880 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-a71923a5-7a58-4d38-a7d1-ccdffa448568 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:50:30.876363 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-a71923a5-7a58-4d38-a7d1-ccdffa448568 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:50:30.877188 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-a71923a5-7a58-4d38-a7d1-ccdffa448568 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:50:30.877620 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-a71923a5-7a58-4d38-a7d1-ccdffa448568 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:50:30.902558 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-a71923a5-7a58-4d38-a7d1-ccdffa448568 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] [instance: 9330dbb8-edad-4d54-afeb-8badc464250d] Going to try to terminate instance {{(pid=123431) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 24 10:50:31.224089 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-32f34ddd-7975-4dab-864e-b56a2413d1ba tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.930835 Dec 24 10:50:31.229910 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 431/855] 10.222.0.30 () {60 vars in 1146 bytes} [Fri Dec 24 10:50:30 2021] POST /compute/v2.1/servers => generated 380 bytes in 937 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 24 10:50:31.235048 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-8df96c7f-bbbc-4715-981a-63409c4a5f46 tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:50:31.239949 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-8df96c7f-bbbc-4715-981a-63409c4a5f46 tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] [instance: 90bed19f-dc1d-408e-8520-34e390ac92cd] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:50:31.326606 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-8df96c7f-bbbc-4715-981a-63409c4a5f46 tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc441b6f06b44beb2a85f854cf92dd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696f3d18f3af4e0eb5760d829e0c3977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:50:31.334154 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-8df96c7f-bbbc-4715-981a-63409c4a5f46 tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] 10.222.0.30 "GET /compute/v2.1/servers/90bed19f-dc1d-408e-8520-34e390ac92cd" status: 200 len: 1218 microversion: 2.1 time: 0.102808 Dec 24 10:50:31.341974 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 432/856] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:50:31 2021] GET /compute/v2.1/servers/90bed19f-dc1d-408e-8520-34e390ac92cd => generated 1218 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:50:31.453707 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-9d22f73a-5220-4224-b2e8-a234f639a25e tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:50:31.454670 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-9d22f73a-5220-4224-b2e8-a234f639a25e tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] [instance: d2c0f276-f763-4337-a5dd-0c328c8c2e73] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:50:31.462379 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-9d22f73a-5220-4224-b2e8-a234f639a25e tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:50:31.462819 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-9d22f73a-5220-4224-b2e8-a234f639a25e tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:50:31.463593 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-9d22f73a-5220-4224-b2e8-a234f639a25e tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:50:31.464025 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-9d22f73a-5220-4224-b2e8-a234f639a25e tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:50:31.479178 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-a71923a5-7a58-4d38-a7d1-ccdffa448568 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] 10.222.0.30 "DELETE /compute/v2.1/servers/9330dbb8-edad-4d54-afeb-8badc464250d" status: 204 len: 0 microversion: 2.1 time: 0.612986 Dec 24 10:50:31.480005 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 425/857] 10.222.0.30 () {58 vars in 1238 bytes} [Fri Dec 24 10:50:30 2021] DELETE /compute/v2.1/servers/9330dbb8-edad-4d54-afeb-8badc464250d => generated 0 bytes in 614 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 24 10:50:31.488205 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-b03b910e-fca0-419a-9163-a986b1201aff tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:50:31.489175 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-b03b910e-fca0-419a-9163-a986b1201aff tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] [instance: 9330dbb8-edad-4d54-afeb-8badc464250d] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:50:31.494892 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-b03b910e-fca0-419a-9163-a986b1201aff tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:50:31.495339 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-b03b910e-fca0-419a-9163-a986b1201aff tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:50:31.496882 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-b03b910e-fca0-419a-9163-a986b1201aff tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:50:31.497316 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-b03b910e-fca0-419a-9163-a986b1201aff tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:50:31.555340 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-9d22f73a-5220-4224-b2e8-a234f639a25e tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] 10.222.0.30 "POST /compute/v2.1/servers/d2c0f276-f763-4337-a5dd-0c328c8c2e73/action" status: 200 len: 26684 microversion: 2.20 time: 0.097158 Dec 24 10:50:31.555340 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 433/858] 10.222.0.30 () {62 vars in 1318 bytes} [Fri Dec 24 10:50:31 2021] POST /compute/v2.1/servers/d2c0f276-f763-4337-a5dd-0c328c8c2e73/action => generated 26684 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 24 10:50:31.636993 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-b03b910e-fca0-419a-9163-a986b1201aff tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37516225f9244c969ed168f6a024482a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0115a5cc8b4b1e8bffb84e0f3e0b08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:50:31.646643 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-b03b910e-fca0-419a-9163-a986b1201aff tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] 10.222.0.30 "GET /compute/v2.1/servers/9330dbb8-edad-4d54-afeb-8badc464250d" status: 200 len: 1674 microversion: 2.1 time: 0.162227 Dec 24 10:50:31.647520 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 426/859] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:50:31 2021] GET /compute/v2.1/servers/9330dbb8-edad-4d54-afeb-8badc464250d => generated 1674 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:50:31.881627 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-0594a2df-4c62-4263-b1fb-461444796a23 tempest-VolumesActionsTest-1489615802 tempest-VolumesActionsTest-1489615802-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:50:31.882472 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-0594a2df-4c62-4263-b1fb-461444796a23 tempest-VolumesActionsTest-1489615802 tempest-VolumesActionsTest-1489615802-project] [instance: e948b5ed-a647-4111-833a-61931190c520] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:50:31.889510 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-0594a2df-4c62-4263-b1fb-461444796a23 tempest-VolumesActionsTest-1489615802 tempest-VolumesActionsTest-1489615802-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:50:31.896991 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-0594a2df-4c62-4263-b1fb-461444796a23 tempest-VolumesActionsTest-1489615802 tempest-VolumesActionsTest-1489615802-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:50:31.896991 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-0594a2df-4c62-4263-b1fb-461444796a23 tempest-VolumesActionsTest-1489615802 tempest-VolumesActionsTest-1489615802-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:50:31.896991 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-0594a2df-4c62-4263-b1fb-461444796a23 tempest-VolumesActionsTest-1489615802 tempest-VolumesActionsTest-1489615802-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:50:32.093902 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-0594a2df-4c62-4263-b1fb-461444796a23 tempest-VolumesActionsTest-1489615802 tempest-VolumesActionsTest-1489615802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b484152f59664123bf8c9d4c56bfebb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8a5fd5e33e4d059b152730ca60d5c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:50:32.104154 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-0594a2df-4c62-4263-b1fb-461444796a23 tempest-VolumesActionsTest-1489615802 tempest-VolumesActionsTest-1489615802-project] 10.222.0.30 "GET /compute/v2.1/servers/e948b5ed-a647-4111-833a-61931190c520" status: 200 len: 1313 microversion: 2.1 time: 0.226708 Dec 24 10:50:32.114119 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 434/860] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:50:31 2021] GET /compute/v2.1/servers/e948b5ed-a647-4111-833a-61931190c520 => generated 1313 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:50:32.351813 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-7350384d-03e9-4642-b73c-d26c795754d6 tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:50:32.352746 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-7350384d-03e9-4642-b73c-d26c795754d6 tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] [instance: 90bed19f-dc1d-408e-8520-34e390ac92cd] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:50:32.423277 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-7350384d-03e9-4642-b73c-d26c795754d6 tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc441b6f06b44beb2a85f854cf92dd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696f3d18f3af4e0eb5760d829e0c3977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:50:32.430312 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-7350384d-03e9-4642-b73c-d26c795754d6 tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] 10.222.0.30 "GET /compute/v2.1/servers/90bed19f-dc1d-408e-8520-34e390ac92cd" status: 200 len: 1218 microversion: 2.1 time: 0.082014 Dec 24 10:50:32.434902 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 427/861] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:50:32 2021] GET /compute/v2.1/servers/90bed19f-dc1d-408e-8520-34e390ac92cd => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:50:32.558725 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-0c013566-927c-4245-a5a5-4504d252daf7 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:50:32.559628 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-0c013566-927c-4245-a5a5-4504d252daf7 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] [instance: d2c0f276-f763-4337-a5dd-0c328c8c2e73] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:50:32.565839 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-0c013566-927c-4245-a5a5-4504d252daf7 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:50:32.566603 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-0c013566-927c-4245-a5a5-4504d252daf7 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:50:32.567609 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-0c013566-927c-4245-a5a5-4504d252daf7 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:50:32.568039 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-0c013566-927c-4245-a5a5-4504d252daf7 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:50:32.645694 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-0c013566-927c-4245-a5a5-4504d252daf7 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] 10.222.0.30 "POST /compute/v2.1/servers/d2c0f276-f763-4337-a5dd-0c328c8c2e73/action" status: 200 len: 27538 microversion: 2.20 time: 0.091716 Dec 24 10:50:32.646384 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 435/862] 10.222.0.30 () {62 vars in 1318 bytes} [Fri Dec 24 10:50:32 2021] POST /compute/v2.1/servers/d2c0f276-f763-4337-a5dd-0c328c8c2e73/action => generated 27538 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 24 10:50:32.664983 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-8162fbeb-28e3-4361-be58-ccd1d7599c01 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:50:32.668267 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-8162fbeb-28e3-4361-be58-ccd1d7599c01 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] [instance: 9330dbb8-edad-4d54-afeb-8badc464250d] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:50:32.673025 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-8162fbeb-28e3-4361-be58-ccd1d7599c01 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:50:32.673576 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-8162fbeb-28e3-4361-be58-ccd1d7599c01 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:50:32.674786 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-8162fbeb-28e3-4361-be58-ccd1d7599c01 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:50:32.675314 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-8162fbeb-28e3-4361-be58-ccd1d7599c01 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:50:32.741379 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [req-c0076e5e-d988-4140-821f-6449c9f87403 req-19df3877-2f69-4437-a6dc-50eae1d53714 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e948b5ed-a647-4111-833a-61931190c520", "tag": "1d3853f2-81fb-48c7-99e2-a8e011c53321"}]} {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:50:32.748507 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 10:50:32.748507 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: warnings.warn(msg) Dec 24 10:50:32.754681 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [req-c0076e5e-d988-4140-821f-6449c9f87403 req-19df3877-2f69-4437-a6dc-50eae1d53714 service nova] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:50:32.755897 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [req-c0076e5e-d988-4140-821f-6449c9f87403 req-19df3877-2f69-4437-a6dc-50eae1d53714 service nova] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:50:32.767299 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.compute.server_external_events [req-c0076e5e-d988-4140-821f-6449c9f87403 req-19df3877-2f69-4437-a6dc-50eae1d53714 service nova] Creating event network-changed:1d3853f2-81fb-48c7-99e2-a8e011c53321 for instance e948b5ed-a647-4111-833a-61931190c520 on hv-cinder-81644 Dec 24 10:50:32.779104 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [req-c0076e5e-d988-4140-821f-6449c9f87403 req-19df3877-2f69-4437-a6dc-50eae1d53714 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037729 Dec 24 10:50:32.779104 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 436/863] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Dec 24 10:50:32 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 24 10:50:32.998528 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-8162fbeb-28e3-4361-be58-ccd1d7599c01 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37516225f9244c969ed168f6a024482a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0115a5cc8b4b1e8bffb84e0f3e0b08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:50:33.009650 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-8162fbeb-28e3-4361-be58-ccd1d7599c01 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] 10.222.0.30 "GET /compute/v2.1/servers/9330dbb8-edad-4d54-afeb-8badc464250d" status: 200 len: 1674 microversion: 2.1 time: 0.347379 Dec 24 10:50:33.010539 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 428/864] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:50:32 2021] GET /compute/v2.1/servers/9330dbb8-edad-4d54-afeb-8badc464250d => generated 1674 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 24 10:50:33.124390 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-0b78bdc6-2e20-4691-bc03-5dba78661a1f tempest-VolumesActionsTest-1489615802 tempest-VolumesActionsTest-1489615802-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:50:33.125240 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-0b78bdc6-2e20-4691-bc03-5dba78661a1f tempest-VolumesActionsTest-1489615802 tempest-VolumesActionsTest-1489615802-project] [instance: e948b5ed-a647-4111-833a-61931190c520] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:50:33.131812 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-0b78bdc6-2e20-4691-bc03-5dba78661a1f tempest-VolumesActionsTest-1489615802 tempest-VolumesActionsTest-1489615802-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:50:33.132260 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-0b78bdc6-2e20-4691-bc03-5dba78661a1f tempest-VolumesActionsTest-1489615802 tempest-VolumesActionsTest-1489615802-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:50:33.133067 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-0b78bdc6-2e20-4691-bc03-5dba78661a1f tempest-VolumesActionsTest-1489615802 tempest-VolumesActionsTest-1489615802-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:50:33.133678 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-0b78bdc6-2e20-4691-bc03-5dba78661a1f tempest-VolumesActionsTest-1489615802 tempest-VolumesActionsTest-1489615802-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:50:33.374506 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-0b78bdc6-2e20-4691-bc03-5dba78661a1f tempest-VolumesActionsTest-1489615802 tempest-VolumesActionsTest-1489615802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b484152f59664123bf8c9d4c56bfebb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8a5fd5e33e4d059b152730ca60d5c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:50:33.381827 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-0b78bdc6-2e20-4691-bc03-5dba78661a1f tempest-VolumesActionsTest-1489615802 tempest-VolumesActionsTest-1489615802-project] 10.222.0.30 "GET /compute/v2.1/servers/e948b5ed-a647-4111-833a-61931190c520" status: 200 len: 1313 microversion: 2.1 time: 0.262908 Dec 24 10:50:33.400186 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 437/865] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:50:33 2021] GET /compute/v2.1/servers/e948b5ed-a647-4111-833a-61931190c520 => generated 1313 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:50:33.447515 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-fbf2f7cf-e5db-4299-9da7-0bc34f9e738a tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:50:33.448243 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-fbf2f7cf-e5db-4299-9da7-0bc34f9e738a tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] [instance: 90bed19f-dc1d-408e-8520-34e390ac92cd] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:50:33.458533 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-fbf2f7cf-e5db-4299-9da7-0bc34f9e738a tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:50:33.460663 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-fbf2f7cf-e5db-4299-9da7-0bc34f9e738a tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:50:33.461627 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-fbf2f7cf-e5db-4299-9da7-0bc34f9e738a tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:50:33.462175 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-fbf2f7cf-e5db-4299-9da7-0bc34f9e738a tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:50:33.564707 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-fbf2f7cf-e5db-4299-9da7-0bc34f9e738a tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc441b6f06b44beb2a85f854cf92dd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696f3d18f3af4e0eb5760d829e0c3977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:50:33.577530 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-fbf2f7cf-e5db-4299-9da7-0bc34f9e738a tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] 10.222.0.30 "GET /compute/v2.1/servers/90bed19f-dc1d-408e-8520-34e390ac92cd" status: 200 len: 1270 microversion: 2.1 time: 0.133147 Dec 24 10:50:33.578975 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 429/866] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:50:33 2021] GET /compute/v2.1/servers/90bed19f-dc1d-408e-8520-34e390ac92cd => generated 1270 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:50:33.657537 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-0d59ecbb-9089-423b-9b3b-204376b164fc tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:50:33.658359 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-0d59ecbb-9089-423b-9b3b-204376b164fc tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] [instance: d2c0f276-f763-4337-a5dd-0c328c8c2e73] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:50:33.668110 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-0d59ecbb-9089-423b-9b3b-204376b164fc tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:50:33.668667 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-0d59ecbb-9089-423b-9b3b-204376b164fc tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:50:33.669380 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-0d59ecbb-9089-423b-9b3b-204376b164fc tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:50:33.669808 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-0d59ecbb-9089-423b-9b3b-204376b164fc tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:50:33.759219 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-0d59ecbb-9089-423b-9b3b-204376b164fc tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] 10.222.0.30 "POST /compute/v2.1/servers/d2c0f276-f763-4337-a5dd-0c328c8c2e73/action" status: 200 len: 27891 microversion: 2.20 time: 0.105272 Dec 24 10:50:33.760272 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 438/867] 10.222.0.30 () {62 vars in 1318 bytes} [Fri Dec 24 10:50:33 2021] POST /compute/v2.1/servers/d2c0f276-f763-4337-a5dd-0c328c8c2e73/action => generated 27891 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 24 10:50:34.031287 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-f224ba33-e22f-4b64-88ea-0c64fb083ca2 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:50:34.031953 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-f224ba33-e22f-4b64-88ea-0c64fb083ca2 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] [instance: 9330dbb8-edad-4d54-afeb-8badc464250d] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:50:34.038400 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-f224ba33-e22f-4b64-88ea-0c64fb083ca2 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:50:34.039086 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-f224ba33-e22f-4b64-88ea-0c64fb083ca2 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:50:34.039988 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-f224ba33-e22f-4b64-88ea-0c64fb083ca2 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:50:34.040627 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-f224ba33-e22f-4b64-88ea-0c64fb083ca2 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:50:34.399788 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-3250b06e-9f0e-41db-a9f8-2a31d863a5c8 tempest-VolumesActionsTest-1489615802 tempest-VolumesActionsTest-1489615802-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:50:34.400491 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-3250b06e-9f0e-41db-a9f8-2a31d863a5c8 tempest-VolumesActionsTest-1489615802 tempest-VolumesActionsTest-1489615802-project] [instance: e948b5ed-a647-4111-833a-61931190c520] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:50:34.407892 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-3250b06e-9f0e-41db-a9f8-2a31d863a5c8 tempest-VolumesActionsTest-1489615802 tempest-VolumesActionsTest-1489615802-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:50:34.408624 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-3250b06e-9f0e-41db-a9f8-2a31d863a5c8 tempest-VolumesActionsTest-1489615802 tempest-VolumesActionsTest-1489615802-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:50:34.409442 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-3250b06e-9f0e-41db-a9f8-2a31d863a5c8 tempest-VolumesActionsTest-1489615802 tempest-VolumesActionsTest-1489615802-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:50:34.409869 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-3250b06e-9f0e-41db-a9f8-2a31d863a5c8 tempest-VolumesActionsTest-1489615802 tempest-VolumesActionsTest-1489615802-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:50:34.560423 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-f224ba33-e22f-4b64-88ea-0c64fb083ca2 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37516225f9244c969ed168f6a024482a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0115a5cc8b4b1e8bffb84e0f3e0b08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:50:34.568464 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-f224ba33-e22f-4b64-88ea-0c64fb083ca2 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] 10.222.0.30 "GET /compute/v2.1/servers/9330dbb8-edad-4d54-afeb-8badc464250d" status: 200 len: 1674 microversion: 2.1 time: 0.541058 Dec 24 10:50:34.569246 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 430/868] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:50:34 2021] GET /compute/v2.1/servers/9330dbb8-edad-4d54-afeb-8badc464250d => generated 1674 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 24 10:50:34.596882 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-96ecea02-05a1-4e25-8fbd-63f34451fcad tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:50:34.597842 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-96ecea02-05a1-4e25-8fbd-63f34451fcad tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] [instance: 90bed19f-dc1d-408e-8520-34e390ac92cd] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:50:34.607435 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-96ecea02-05a1-4e25-8fbd-63f34451fcad tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:50:34.608043 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-96ecea02-05a1-4e25-8fbd-63f34451fcad tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:50:34.609189 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-96ecea02-05a1-4e25-8fbd-63f34451fcad tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:50:34.609731 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-96ecea02-05a1-4e25-8fbd-63f34451fcad tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:50:34.686303 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-96ecea02-05a1-4e25-8fbd-63f34451fcad tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc441b6f06b44beb2a85f854cf92dd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696f3d18f3af4e0eb5760d829e0c3977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:50:34.693754 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-96ecea02-05a1-4e25-8fbd-63f34451fcad tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] 10.222.0.30 "GET /compute/v2.1/servers/90bed19f-dc1d-408e-8520-34e390ac92cd" status: 200 len: 1276 microversion: 2.1 time: 0.101816 Dec 24 10:50:34.694564 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 431/869] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:50:34 2021] GET /compute/v2.1/servers/90bed19f-dc1d-408e-8520-34e390ac92cd => generated 1276 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 24 10:50:34.771714 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-ff801e11-6fe1-4620-971e-b2b7360ff010 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:50:34.772744 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-ff801e11-6fe1-4620-971e-b2b7360ff010 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] [instance: d2c0f276-f763-4337-a5dd-0c328c8c2e73] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:50:34.779052 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-ff801e11-6fe1-4620-971e-b2b7360ff010 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:50:34.779482 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-ff801e11-6fe1-4620-971e-b2b7360ff010 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:50:34.780242 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-ff801e11-6fe1-4620-971e-b2b7360ff010 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:50:34.780663 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-ff801e11-6fe1-4620-971e-b2b7360ff010 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:50:34.799862 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-3250b06e-9f0e-41db-a9f8-2a31d863a5c8 tempest-VolumesActionsTest-1489615802 tempest-VolumesActionsTest-1489615802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b484152f59664123bf8c9d4c56bfebb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8a5fd5e33e4d059b152730ca60d5c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:50:34.809414 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-3250b06e-9f0e-41db-a9f8-2a31d863a5c8 tempest-VolumesActionsTest-1489615802 tempest-VolumesActionsTest-1489615802-project] 10.222.0.30 "GET /compute/v2.1/servers/e948b5ed-a647-4111-833a-61931190c520" status: 200 len: 1313 microversion: 2.1 time: 0.413490 Dec 24 10:50:34.812990 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 439/870] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:50:34 2021] GET /compute/v2.1/servers/e948b5ed-a647-4111-833a-61931190c520 => generated 1313 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 24 10:50:34.856792 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-ff801e11-6fe1-4620-971e-b2b7360ff010 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] 10.222.0.30 "POST /compute/v2.1/servers/d2c0f276-f763-4337-a5dd-0c328c8c2e73/action" status: 200 len: 28261 microversion: 2.20 time: 0.088739 Dec 24 10:50:34.857615 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 432/871] 10.222.0.30 () {62 vars in 1318 bytes} [Fri Dec 24 10:50:34 2021] POST /compute/v2.1/servers/d2c0f276-f763-4337-a5dd-0c328c8c2e73/action => generated 28261 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 24 10:50:35.600475 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-06516bc4-913d-4ae2-ad14-f659912adfd5 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:50:35.600475 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-06516bc4-913d-4ae2-ad14-f659912adfd5 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] [instance: 9330dbb8-edad-4d54-afeb-8badc464250d] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:50:35.600475 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-06516bc4-913d-4ae2-ad14-f659912adfd5 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:50:35.600475 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-06516bc4-913d-4ae2-ad14-f659912adfd5 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:50:35.601074 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-06516bc4-913d-4ae2-ad14-f659912adfd5 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:50:35.601074 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-06516bc4-913d-4ae2-ad14-f659912adfd5 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:50:35.684176 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-06516bc4-913d-4ae2-ad14-f659912adfd5 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37516225f9244c969ed168f6a024482a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0115a5cc8b4b1e8bffb84e0f3e0b08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:50:35.693737 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-06516bc4-913d-4ae2-ad14-f659912adfd5 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] 10.222.0.30 "GET /compute/v2.1/servers/9330dbb8-edad-4d54-afeb-8badc464250d" status: 200 len: 1607 microversion: 2.1 time: 0.111437 Dec 24 10:50:35.694558 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 440/872] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:50:35 2021] GET /compute/v2.1/servers/9330dbb8-edad-4d54-afeb-8badc464250d => generated 1607 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:50:35.713590 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-3f029c8a-2406-4299-b6e7-7467a7603c9c tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:50:35.714964 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-3f029c8a-2406-4299-b6e7-7467a7603c9c tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] [instance: 90bed19f-dc1d-408e-8520-34e390ac92cd] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:50:35.721873 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-3f029c8a-2406-4299-b6e7-7467a7603c9c tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:50:35.722610 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-3f029c8a-2406-4299-b6e7-7467a7603c9c tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:50:35.723565 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-3f029c8a-2406-4299-b6e7-7467a7603c9c tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:50:35.725000 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-3f029c8a-2406-4299-b6e7-7467a7603c9c tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:50:35.986057 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [req-5e2d1a18-0c15-4188-820c-c882268f4a0b req-12a7d00c-1172-4382-a67e-dc355016dd4a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9330dbb8-edad-4d54-afeb-8badc464250d", "name": "network-vif-deleted", "tag": "0cea520e-6ec2-4fe3-8f62-bfb44b96b73e"}]} {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:50:35.987756 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 10:50:35.987756 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: warnings.warn(msg) Dec 24 10:50:35.994833 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [req-5e2d1a18-0c15-4188-820c-c882268f4a0b req-12a7d00c-1172-4382-a67e-dc355016dd4a service nova] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:50:35.996057 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [req-5e2d1a18-0c15-4188-820c-c882268f4a0b req-12a7d00c-1172-4382-a67e-dc355016dd4a service nova] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:50:36.009277 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.compute.server_external_events [req-5e2d1a18-0c15-4188-820c-c882268f4a0b req-12a7d00c-1172-4382-a67e-dc355016dd4a service nova] Creating event network-vif-deleted:0cea520e-6ec2-4fe3-8f62-bfb44b96b73e for instance 9330dbb8-edad-4d54-afeb-8badc464250d on hv-cinder-81644 Dec 24 10:50:36.016877 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [req-5e2d1a18-0c15-4188-820c-c882268f4a0b req-12a7d00c-1172-4382-a67e-dc355016dd4a service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.266007 Dec 24 10:50:36.018446 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 441/873] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Dec 24 10:50:35 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 10:50:36.025402 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-7d95dfd2-b306-4f0b-a10a-8eeb935ad2b2 tempest-VolumesActionsTest-1489615802 tempest-VolumesActionsTest-1489615802-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:50:36.026308 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-7d95dfd2-b306-4f0b-a10a-8eeb935ad2b2 tempest-VolumesActionsTest-1489615802 tempest-VolumesActionsTest-1489615802-project] [instance: e948b5ed-a647-4111-833a-61931190c520] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:50:36.033176 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-7d95dfd2-b306-4f0b-a10a-8eeb935ad2b2 tempest-VolumesActionsTest-1489615802 tempest-VolumesActionsTest-1489615802-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:50:36.033965 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-7d95dfd2-b306-4f0b-a10a-8eeb935ad2b2 tempest-VolumesActionsTest-1489615802 tempest-VolumesActionsTest-1489615802-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:50:36.034981 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-7d95dfd2-b306-4f0b-a10a-8eeb935ad2b2 tempest-VolumesActionsTest-1489615802 tempest-VolumesActionsTest-1489615802-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:50:36.035622 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-7d95dfd2-b306-4f0b-a10a-8eeb935ad2b2 tempest-VolumesActionsTest-1489615802 tempest-VolumesActionsTest-1489615802-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:50:36.114163 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-3f029c8a-2406-4299-b6e7-7467a7603c9c tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc441b6f06b44beb2a85f854cf92dd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696f3d18f3af4e0eb5760d829e0c3977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:50:36.128465 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-3f029c8a-2406-4299-b6e7-7467a7603c9c tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] 10.222.0.30 "GET /compute/v2.1/servers/90bed19f-dc1d-408e-8520-34e390ac92cd" status: 200 len: 1318 microversion: 2.1 time: 0.414159 Dec 24 10:50:36.131739 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 433/874] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:50:35 2021] GET /compute/v2.1/servers/90bed19f-dc1d-408e-8520-34e390ac92cd => generated 1318 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:50:36.140754 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-4ecd663a-f32a-4003-af63-c9e49b62453b tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:50:36.142583 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-4ecd663a-f32a-4003-af63-c9e49b62453b tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] [instance: d2c0f276-f763-4337-a5dd-0c328c8c2e73] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:50:36.155514 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-4ecd663a-f32a-4003-af63-c9e49b62453b tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:50:36.156396 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-4ecd663a-f32a-4003-af63-c9e49b62453b tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:50:36.160290 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-4ecd663a-f32a-4003-af63-c9e49b62453b tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:50:36.161130 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-4ecd663a-f32a-4003-af63-c9e49b62453b tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:50:36.234944 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-4ecd663a-f32a-4003-af63-c9e49b62453b tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] 10.222.0.30 "POST /compute/v2.1/servers/d2c0f276-f763-4337-a5dd-0c328c8c2e73/action" status: 200 len: 28261 microversion: 2.20 time: 0.101636 Dec 24 10:50:36.235960 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 434/875] 10.222.0.30 () {62 vars in 1318 bytes} [Fri Dec 24 10:50:36 2021] POST /compute/v2.1/servers/d2c0f276-f763-4337-a5dd-0c328c8c2e73/action => generated 28261 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 24 10:50:36.275115 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-7d95dfd2-b306-4f0b-a10a-8eeb935ad2b2 tempest-VolumesActionsTest-1489615802 tempest-VolumesActionsTest-1489615802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b484152f59664123bf8c9d4c56bfebb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8a5fd5e33e4d059b152730ca60d5c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:50:36.283768 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-7d95dfd2-b306-4f0b-a10a-8eeb935ad2b2 tempest-VolumesActionsTest-1489615802 tempest-VolumesActionsTest-1489615802-project] 10.222.0.30 "GET /compute/v2.1/servers/e948b5ed-a647-4111-833a-61931190c520" status: 200 len: 1313 microversion: 2.1 time: 0.263151 Dec 24 10:50:36.284213 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 442/876] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:50:36 2021] GET /compute/v2.1/servers/e948b5ed-a647-4111-833a-61931190c520 => generated 1313 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:50:36.711374 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-bcbaf0e7-90ac-4b21-987e-c1035414f9a9 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:50:36.711994 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-bcbaf0e7-90ac-4b21-987e-c1035414f9a9 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] [instance: 9330dbb8-edad-4d54-afeb-8badc464250d] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:50:36.719406 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-bcbaf0e7-90ac-4b21-987e-c1035414f9a9 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:50:36.720020 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-bcbaf0e7-90ac-4b21-987e-c1035414f9a9 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:50:36.720610 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-bcbaf0e7-90ac-4b21-987e-c1035414f9a9 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:50:36.721063 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-bcbaf0e7-90ac-4b21-987e-c1035414f9a9 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:50:36.751444 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-bcbaf0e7-90ac-4b21-987e-c1035414f9a9 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:50:36.751886 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-bcbaf0e7-90ac-4b21-987e-c1035414f9a9 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:50:36.752318 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.objects.instance [None req-bcbaf0e7-90ac-4b21-987e-c1035414f9a9 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lazy-loading 'fault' on Instance uuid 9330dbb8-edad-4d54-afeb-8badc464250d {{(pid=123431) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 24 10:50:36.800123 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-bcbaf0e7-90ac-4b21-987e-c1035414f9a9 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37516225f9244c969ed168f6a024482a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0115a5cc8b4b1e8bffb84e0f3e0b08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:50:36.807979 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-bcbaf0e7-90ac-4b21-987e-c1035414f9a9 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] 10.222.0.30 "GET /compute/v2.1/servers/9330dbb8-edad-4d54-afeb-8badc464250d" status: 200 len: 1328 microversion: 2.1 time: 0.100574 Dec 24 10:50:36.808567 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 435/877] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:50:36 2021] GET /compute/v2.1/servers/9330dbb8-edad-4d54-afeb-8badc464250d => generated 1328 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:50:36.867993 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [req-cfa4939a-e55b-4955-8a1b-e3947d701cb8 req-15e0bec8-900e-4d43-a269-7c6c759c287d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "90bed19f-dc1d-408e-8520-34e390ac92cd", "tag": "0a1505e6-626c-4f03-8fa1-81e71b8f72d5"}]} {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:50:36.871014 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 10:50:36.871014 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: warnings.warn(msg) Dec 24 10:50:36.888022 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [req-cfa4939a-e55b-4955-8a1b-e3947d701cb8 req-15e0bec8-900e-4d43-a269-7c6c759c287d service nova] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:50:36.888488 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [req-cfa4939a-e55b-4955-8a1b-e3947d701cb8 req-15e0bec8-900e-4d43-a269-7c6c759c287d service nova] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:50:36.908949 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.compute.server_external_events [req-cfa4939a-e55b-4955-8a1b-e3947d701cb8 req-15e0bec8-900e-4d43-a269-7c6c759c287d service nova] Creating event network-changed:0a1505e6-626c-4f03-8fa1-81e71b8f72d5 for instance 90bed19f-dc1d-408e-8520-34e390ac92cd on hv-cinder-81644 Dec 24 10:50:36.914142 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [req-cfa4939a-e55b-4955-8a1b-e3947d701cb8 req-15e0bec8-900e-4d43-a269-7c6c759c287d service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055485 Dec 24 10:50:36.914912 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 443/878] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Dec 24 10:50:36 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 10:50:37.140147 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-7afb73c7-ab83-4f87-a9ed-31e609a7bc1c tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:50:37.140762 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-7afb73c7-ab83-4f87-a9ed-31e609a7bc1c tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] [instance: 90bed19f-dc1d-408e-8520-34e390ac92cd] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:50:37.150273 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-7afb73c7-ab83-4f87-a9ed-31e609a7bc1c tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:50:37.151173 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-7afb73c7-ab83-4f87-a9ed-31e609a7bc1c tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:50:37.152715 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-7afb73c7-ab83-4f87-a9ed-31e609a7bc1c tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:50:37.153420 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-7afb73c7-ab83-4f87-a9ed-31e609a7bc1c tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:50:37.248494 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-6c4350fc-1576-4cac-a12a-0080734e39e0 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:50:37.253040 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-6c4350fc-1576-4cac-a12a-0080734e39e0 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] [instance: d2c0f276-f763-4337-a5dd-0c328c8c2e73] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:50:37.262756 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-6c4350fc-1576-4cac-a12a-0080734e39e0 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:50:37.263194 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-6c4350fc-1576-4cac-a12a-0080734e39e0 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:50:37.264169 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-6c4350fc-1576-4cac-a12a-0080734e39e0 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:50:37.264599 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-6c4350fc-1576-4cac-a12a-0080734e39e0 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:50:37.342875 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-6c4350fc-1576-4cac-a12a-0080734e39e0 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] 10.222.0.30 "POST /compute/v2.1/servers/d2c0f276-f763-4337-a5dd-0c328c8c2e73/action" status: 200 len: 28552 microversion: 2.20 time: 0.098736 Dec 24 10:50:37.343522 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 444/879] 10.222.0.30 () {62 vars in 1318 bytes} [Fri Dec 24 10:50:37 2021] POST /compute/v2.1/servers/d2c0f276-f763-4337-a5dd-0c328c8c2e73/action => generated 28552 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 24 10:50:37.349069 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-c5fb08a3-0327-4a2e-bb8a-8d8923562f10 tempest-VolumesActionsTest-1489615802 tempest-VolumesActionsTest-1489615802-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:50:37.349759 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-c5fb08a3-0327-4a2e-bb8a-8d8923562f10 tempest-VolumesActionsTest-1489615802 tempest-VolumesActionsTest-1489615802-project] [instance: e948b5ed-a647-4111-833a-61931190c520] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:50:37.356665 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-7afb73c7-ab83-4f87-a9ed-31e609a7bc1c tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc441b6f06b44beb2a85f854cf92dd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696f3d18f3af4e0eb5760d829e0c3977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:50:37.358763 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-c5fb08a3-0327-4a2e-bb8a-8d8923562f10 tempest-VolumesActionsTest-1489615802 tempest-VolumesActionsTest-1489615802-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:50:37.358763 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-c5fb08a3-0327-4a2e-bb8a-8d8923562f10 tempest-VolumesActionsTest-1489615802 tempest-VolumesActionsTest-1489615802-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:50:37.358763 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-c5fb08a3-0327-4a2e-bb8a-8d8923562f10 tempest-VolumesActionsTest-1489615802 tempest-VolumesActionsTest-1489615802-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:50:37.358763 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-c5fb08a3-0327-4a2e-bb8a-8d8923562f10 tempest-VolumesActionsTest-1489615802 tempest-VolumesActionsTest-1489615802-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:50:37.365887 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-7afb73c7-ab83-4f87-a9ed-31e609a7bc1c tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] 10.222.0.30 "GET /compute/v2.1/servers/90bed19f-dc1d-408e-8520-34e390ac92cd" status: 200 len: 1318 microversion: 2.1 time: 0.231212 Dec 24 10:50:37.366479 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 436/880] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:50:37 2021] GET /compute/v2.1/servers/90bed19f-dc1d-408e-8520-34e390ac92cd => generated 1318 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:50:37.497991 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-c5fb08a3-0327-4a2e-bb8a-8d8923562f10 tempest-VolumesActionsTest-1489615802 tempest-VolumesActionsTest-1489615802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b484152f59664123bf8c9d4c56bfebb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8a5fd5e33e4d059b152730ca60d5c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:50:37.505603 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-c5fb08a3-0327-4a2e-bb8a-8d8923562f10 tempest-VolumesActionsTest-1489615802 tempest-VolumesActionsTest-1489615802-project] 10.222.0.30 "GET /compute/v2.1/servers/e948b5ed-a647-4111-833a-61931190c520" status: 200 len: 1313 microversion: 2.1 time: 0.160722 Dec 24 10:50:37.506271 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 445/881] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:50:37 2021] GET /compute/v2.1/servers/e948b5ed-a647-4111-833a-61931190c520 => generated 1313 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:50:37.825749 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-ba12e4f5-1b42-4616-92a8-c01afcdc6f5c tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:50:37.826417 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-ba12e4f5-1b42-4616-92a8-c01afcdc6f5c tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] [instance: 9330dbb8-edad-4d54-afeb-8badc464250d] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:50:37.832749 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-ba12e4f5-1b42-4616-92a8-c01afcdc6f5c tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:50:37.833251 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-ba12e4f5-1b42-4616-92a8-c01afcdc6f5c tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:50:37.834103 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-ba12e4f5-1b42-4616-92a8-c01afcdc6f5c tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:50:37.834540 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-ba12e4f5-1b42-4616-92a8-c01afcdc6f5c tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:50:37.849893 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.wsgi [None req-ba12e4f5-1b42-4616-92a8-c01afcdc6f5c tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] HTTP exception thrown: Instance 9330dbb8-edad-4d54-afeb-8badc464250d could not be found. Dec 24 10:50:37.851253 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-ba12e4f5-1b42-4616-92a8-c01afcdc6f5c tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Returning 404 to user: Instance 9330dbb8-edad-4d54-afeb-8badc464250d could not be found. {{(pid=123431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 24 10:50:37.851649 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-ba12e4f5-1b42-4616-92a8-c01afcdc6f5c tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] 10.222.0.30 "GET /compute/v2.1/servers/9330dbb8-edad-4d54-afeb-8badc464250d" status: 404 len: 111 microversion: 2.1 time: 0.029920 Dec 24 10:50:37.852410 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 437/882] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:50:37 2021] GET /compute/v2.1/servers/9330dbb8-edad-4d54-afeb-8badc464250d => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 24 10:50:37.861047 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-d04a1d5d-a1da-447b-93a1-7edd928e8cab tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Calling method '.version_select at 0x7f1899b8e8b0>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:50:38.051466 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-d04a1d5d-a1da-447b-93a1-7edd928e8cab tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1861528941" status: 202 len: 0 microversion: 2.1 time: 0.194262 Dec 24 10:50:38.052059 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 446/883] 10.222.0.30 () {58 vars in 1220 bytes} [Fri Dec 24 10:50:37 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1861528941 => generated 0 bytes in 196 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Dec 24 10:50:38.361657 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-c345dcb6-c7ce-434c-bd13-19a8f44be756 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:50:38.362855 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-c345dcb6-c7ce-434c-bd13-19a8f44be756 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] [instance: d2c0f276-f763-4337-a5dd-0c328c8c2e73] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:50:38.369114 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-c345dcb6-c7ce-434c-bd13-19a8f44be756 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:50:38.373769 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-c345dcb6-c7ce-434c-bd13-19a8f44be756 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:50:38.374857 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-c345dcb6-c7ce-434c-bd13-19a8f44be756 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:50:38.376301 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-c345dcb6-c7ce-434c-bd13-19a8f44be756 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:50:38.384166 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-ace9c35d-9a29-43d1-9c14-e4a0f5e244dc tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:50:38.384906 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-ace9c35d-9a29-43d1-9c14-e4a0f5e244dc tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] [instance: 90bed19f-dc1d-408e-8520-34e390ac92cd] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:50:38.392163 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-ace9c35d-9a29-43d1-9c14-e4a0f5e244dc tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:50:38.392709 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-ace9c35d-9a29-43d1-9c14-e4a0f5e244dc tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:50:38.393845 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-ace9c35d-9a29-43d1-9c14-e4a0f5e244dc tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:50:38.394950 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-ace9c35d-9a29-43d1-9c14-e4a0f5e244dc tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:50:38.460158 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-c345dcb6-c7ce-434c-bd13-19a8f44be756 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] 10.222.0.30 "POST /compute/v2.1/servers/d2c0f276-f763-4337-a5dd-0c328c8c2e73/action" status: 200 len: 28720 microversion: 2.20 time: 0.109017 Dec 24 10:50:38.465596 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 438/884] 10.222.0.30 () {62 vars in 1318 bytes} [Fri Dec 24 10:50:38 2021] POST /compute/v2.1/servers/d2c0f276-f763-4337-a5dd-0c328c8c2e73/action => generated 28720 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 24 10:50:38.523184 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-5b0af72b-a74e-4c11-8156-fe03cdb3388c tempest-VolumesActionsTest-1489615802 tempest-VolumesActionsTest-1489615802-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:50:38.523871 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-5b0af72b-a74e-4c11-8156-fe03cdb3388c tempest-VolumesActionsTest-1489615802 tempest-VolumesActionsTest-1489615802-project] [instance: e948b5ed-a647-4111-833a-61931190c520] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:50:38.530815 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-5b0af72b-a74e-4c11-8156-fe03cdb3388c tempest-VolumesActionsTest-1489615802 tempest-VolumesActionsTest-1489615802-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:50:38.531264 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-5b0af72b-a74e-4c11-8156-fe03cdb3388c tempest-VolumesActionsTest-1489615802 tempest-VolumesActionsTest-1489615802-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:50:38.532043 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-5b0af72b-a74e-4c11-8156-fe03cdb3388c tempest-VolumesActionsTest-1489615802 tempest-VolumesActionsTest-1489615802-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:50:38.532472 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-5b0af72b-a74e-4c11-8156-fe03cdb3388c tempest-VolumesActionsTest-1489615802 tempest-VolumesActionsTest-1489615802-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:50:38.595821 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-ace9c35d-9a29-43d1-9c14-e4a0f5e244dc tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc441b6f06b44beb2a85f854cf92dd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696f3d18f3af4e0eb5760d829e0c3977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:50:38.605722 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-ace9c35d-9a29-43d1-9c14-e4a0f5e244dc tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] 10.222.0.30 "GET /compute/v2.1/servers/90bed19f-dc1d-408e-8520-34e390ac92cd" status: 200 len: 1318 microversion: 2.1 time: 0.226470 Dec 24 10:50:38.615268 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 447/885] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:50:38 2021] GET /compute/v2.1/servers/90bed19f-dc1d-408e-8520-34e390ac92cd => generated 1318 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 24 10:50:38.679343 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-5b0af72b-a74e-4c11-8156-fe03cdb3388c tempest-VolumesActionsTest-1489615802 tempest-VolumesActionsTest-1489615802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b484152f59664123bf8c9d4c56bfebb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8a5fd5e33e4d059b152730ca60d5c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:50:38.695318 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-5b0af72b-a74e-4c11-8156-fe03cdb3388c tempest-VolumesActionsTest-1489615802 tempest-VolumesActionsTest-1489615802-project] 10.222.0.30 "GET /compute/v2.1/servers/e948b5ed-a647-4111-833a-61931190c520" status: 200 len: 1313 microversion: 2.1 time: 0.168704 Dec 24 10:50:38.695318 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 439/886] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:50:38 2021] GET /compute/v2.1/servers/e948b5ed-a647-4111-833a-61931190c520 => generated 1313 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 24 10:50:38.977445 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-a1aeee79-9461-4809-bfd6-bad7dab95ac5 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Action: 'create', calling method: .version_select at 0x7f1899b090d0>, body: {"keypair": {"name": "tempest-keypair-1139497446"}} {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:50:38.991961 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.quota [None req-a1aeee79-9461-4809-bfd6-bad7dab95ac5 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Getting quotas for project 3f0115a5cc8b4b1e8bffb84e0f3e0b08. Resources: {'key_pairs'} {{(pid=123432) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 24 10:50:38.996293 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.quota [None req-a1aeee79-9461-4809-bfd6-bad7dab95ac5 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Getting quotas for user 37516225f9244c969ed168f6a024482a and project 3f0115a5cc8b4b1e8bffb84e0f3e0b08. Resources: {'key_pairs'} {{(pid=123432) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 24 10:50:39.265963 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.quota [None req-a1aeee79-9461-4809-bfd6-bad7dab95ac5 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Getting quotas for project 3f0115a5cc8b4b1e8bffb84e0f3e0b08. Resources: {'key_pairs'} {{(pid=123432) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 24 10:50:39.269768 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.quota [None req-a1aeee79-9461-4809-bfd6-bad7dab95ac5 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Getting quotas for user 37516225f9244c969ed168f6a024482a and project 3f0115a5cc8b4b1e8bffb84e0f3e0b08. Resources: {'key_pairs'} {{(pid=123432) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 24 10:50:39.282179 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-a1aeee79-9461-4809-bfd6-bad7dab95ac5 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 2305 microversion: 2.1 time: 0.308410 Dec 24 10:50:39.282769 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 448/887] 10.222.0.30 () {60 vars in 1157 bytes} [Fri Dec 24 10:50:38 2021] POST /compute/v2.1/os-keypairs => generated 2305 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:50:39.476693 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-60a7a8e2-b4c7-4b91-84e5-989fb7e85dcb tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:50:39.477685 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-60a7a8e2-b4c7-4b91-84e5-989fb7e85dcb tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] [instance: d2c0f276-f763-4337-a5dd-0c328c8c2e73] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:50:39.484504 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-60a7a8e2-b4c7-4b91-84e5-989fb7e85dcb tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:50:39.484985 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-60a7a8e2-b4c7-4b91-84e5-989fb7e85dcb tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:50:39.485767 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-60a7a8e2-b4c7-4b91-84e5-989fb7e85dcb tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:50:39.486205 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-60a7a8e2-b4c7-4b91-84e5-989fb7e85dcb tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:50:39.549291 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-60a7a8e2-b4c7-4b91-84e5-989fb7e85dcb tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] 10.222.0.30 "POST /compute/v2.1/servers/d2c0f276-f763-4337-a5dd-0c328c8c2e73/action" status: 200 len: 28720 microversion: 2.20 time: 0.076052 Dec 24 10:50:39.550358 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 440/888] 10.222.0.30 () {62 vars in 1318 bytes} [Fri Dec 24 10:50:39 2021] POST /compute/v2.1/servers/d2c0f276-f763-4337-a5dd-0c328c8c2e73/action => generated 28720 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 24 10:50:39.623016 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-1c9a20f6-fea7-4e27-828a-5ad90cf261a0 tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:50:39.623631 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-1c9a20f6-fea7-4e27-828a-5ad90cf261a0 tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] [instance: 90bed19f-dc1d-408e-8520-34e390ac92cd] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:50:39.629692 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-1c9a20f6-fea7-4e27-828a-5ad90cf261a0 tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:50:39.630147 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-1c9a20f6-fea7-4e27-828a-5ad90cf261a0 tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:50:39.630942 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-1c9a20f6-fea7-4e27-828a-5ad90cf261a0 tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:50:39.631372 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-1c9a20f6-fea7-4e27-828a-5ad90cf261a0 tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:50:39.709590 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-c7a20441-d84b-44f0-bd23-fd60d5960f06 tempest-VolumesActionsTest-1489615802 tempest-VolumesActionsTest-1489615802-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:50:39.710271 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-c7a20441-d84b-44f0-bd23-fd60d5960f06 tempest-VolumesActionsTest-1489615802 tempest-VolumesActionsTest-1489615802-project] [instance: e948b5ed-a647-4111-833a-61931190c520] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:50:39.718165 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-c7a20441-d84b-44f0-bd23-fd60d5960f06 tempest-VolumesActionsTest-1489615802 tempest-VolumesActionsTest-1489615802-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:50:39.718599 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-c7a20441-d84b-44f0-bd23-fd60d5960f06 tempest-VolumesActionsTest-1489615802 tempest-VolumesActionsTest-1489615802-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:50:39.719797 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-c7a20441-d84b-44f0-bd23-fd60d5960f06 tempest-VolumesActionsTest-1489615802 tempest-VolumesActionsTest-1489615802-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:50:39.720069 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-c7a20441-d84b-44f0-bd23-fd60d5960f06 tempest-VolumesActionsTest-1489615802 tempest-VolumesActionsTest-1489615802-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:50:39.791410 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-1c9a20f6-fea7-4e27-828a-5ad90cf261a0 tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc441b6f06b44beb2a85f854cf92dd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696f3d18f3af4e0eb5760d829e0c3977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:50:39.799550 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-1c9a20f6-fea7-4e27-828a-5ad90cf261a0 tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] 10.222.0.30 "GET /compute/v2.1/servers/90bed19f-dc1d-408e-8520-34e390ac92cd" status: 200 len: 1318 microversion: 2.1 time: 0.180258 Dec 24 10:50:39.800516 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 449/889] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:50:39 2021] GET /compute/v2.1/servers/90bed19f-dc1d-408e-8520-34e390ac92cd => generated 1318 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:50:39.858432 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-c7a20441-d84b-44f0-bd23-fd60d5960f06 tempest-VolumesActionsTest-1489615802 tempest-VolumesActionsTest-1489615802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b484152f59664123bf8c9d4c56bfebb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8a5fd5e33e4d059b152730ca60d5c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:50:39.866314 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-c7a20441-d84b-44f0-bd23-fd60d5960f06 tempest-VolumesActionsTest-1489615802 tempest-VolumesActionsTest-1489615802-project] 10.222.0.30 "GET /compute/v2.1/servers/e948b5ed-a647-4111-833a-61931190c520" status: 200 len: 1313 microversion: 2.1 time: 0.160753 Dec 24 10:50:39.867105 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 441/890] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:50:39 2021] GET /compute/v2.1/servers/e948b5ed-a647-4111-833a-61931190c520 => generated 1313 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 24 10:50:40.269440 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [req-35ea81ed-7308-4e9d-b287-946f1cba5fc2 req-71b969f3-7659-410d-a1c9-2d0fa383fde7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e948b5ed-a647-4111-833a-61931190c520", "name": "network-vif-plugged", "status": "completed", "tag": "1d3853f2-81fb-48c7-99e2-a8e011c53321"}]} {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:50:40.270936 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 10:50:40.270936 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: warnings.warn(msg) Dec 24 10:50:40.277925 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [req-35ea81ed-7308-4e9d-b287-946f1cba5fc2 req-71b969f3-7659-410d-a1c9-2d0fa383fde7 service nova] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:50:40.278568 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [req-35ea81ed-7308-4e9d-b287-946f1cba5fc2 req-71b969f3-7659-410d-a1c9-2d0fa383fde7 service nova] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:50:40.289675 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.compute.server_external_events [req-35ea81ed-7308-4e9d-b287-946f1cba5fc2 req-71b969f3-7659-410d-a1c9-2d0fa383fde7 service nova] Creating event network-vif-plugged:1d3853f2-81fb-48c7-99e2-a8e011c53321 for instance e948b5ed-a647-4111-833a-61931190c520 on hv-cinder-81644 Dec 24 10:50:40.303215 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [req-35ea81ed-7308-4e9d-b287-946f1cba5fc2 req-71b969f3-7659-410d-a1c9-2d0fa383fde7 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.221744 Dec 24 10:50:40.303215 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 450/891] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Dec 24 10:50:40 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 10:50:40.562168 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-c82c1508-2033-459d-b05d-8dc6bb0bf85e tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:50:40.563129 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-c82c1508-2033-459d-b05d-8dc6bb0bf85e tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] [instance: d2c0f276-f763-4337-a5dd-0c328c8c2e73] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:50:40.570010 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-c82c1508-2033-459d-b05d-8dc6bb0bf85e tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:50:40.570457 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-c82c1508-2033-459d-b05d-8dc6bb0bf85e tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:50:40.571290 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-c82c1508-2033-459d-b05d-8dc6bb0bf85e tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:50:40.571717 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-c82c1508-2033-459d-b05d-8dc6bb0bf85e tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:50:40.635832 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-c82c1508-2033-459d-b05d-8dc6bb0bf85e tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] 10.222.0.30 "POST /compute/v2.1/servers/d2c0f276-f763-4337-a5dd-0c328c8c2e73/action" status: 200 len: 28720 microversion: 2.20 time: 0.078312 Dec 24 10:50:40.639881 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 442/892] 10.222.0.30 () {62 vars in 1318 bytes} [Fri Dec 24 10:50:40 2021] POST /compute/v2.1/servers/d2c0f276-f763-4337-a5dd-0c328c8c2e73/action => generated 28720 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 24 10:50:40.816660 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-68cb51ed-4841-4e0a-80f3-4243f4d38dbd tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:50:40.817337 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-68cb51ed-4841-4e0a-80f3-4243f4d38dbd tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] [instance: 90bed19f-dc1d-408e-8520-34e390ac92cd] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:50:40.824177 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-68cb51ed-4841-4e0a-80f3-4243f4d38dbd tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:50:40.824629 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-68cb51ed-4841-4e0a-80f3-4243f4d38dbd tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:50:40.825440 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-68cb51ed-4841-4e0a-80f3-4243f4d38dbd tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:50:40.825867 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-68cb51ed-4841-4e0a-80f3-4243f4d38dbd tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:50:40.887905 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-1c845b88-3be5-4277-ad9f-13e911ae193e tempest-VolumesActionsTest-1489615802 tempest-VolumesActionsTest-1489615802-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:50:40.889490 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-1c845b88-3be5-4277-ad9f-13e911ae193e tempest-VolumesActionsTest-1489615802 tempest-VolumesActionsTest-1489615802-project] [instance: e948b5ed-a647-4111-833a-61931190c520] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:50:40.901855 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-1c845b88-3be5-4277-ad9f-13e911ae193e tempest-VolumesActionsTest-1489615802 tempest-VolumesActionsTest-1489615802-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:50:40.902646 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-1c845b88-3be5-4277-ad9f-13e911ae193e tempest-VolumesActionsTest-1489615802 tempest-VolumesActionsTest-1489615802-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:50:40.904023 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-1c845b88-3be5-4277-ad9f-13e911ae193e tempest-VolumesActionsTest-1489615802 tempest-VolumesActionsTest-1489615802-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:50:40.904840 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-1c845b88-3be5-4277-ad9f-13e911ae193e tempest-VolumesActionsTest-1489615802 tempest-VolumesActionsTest-1489615802-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:50:41.172080 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-1c845b88-3be5-4277-ad9f-13e911ae193e tempest-VolumesActionsTest-1489615802 tempest-VolumesActionsTest-1489615802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b484152f59664123bf8c9d4c56bfebb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8a5fd5e33e4d059b152730ca60d5c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:50:41.180790 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-1c845b88-3be5-4277-ad9f-13e911ae193e tempest-VolumesActionsTest-1489615802 tempest-VolumesActionsTest-1489615802-project] 10.222.0.30 "GET /compute/v2.1/servers/e948b5ed-a647-4111-833a-61931190c520" status: 200 len: 1313 microversion: 2.1 time: 0.300495 Dec 24 10:50:41.181394 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 443/893] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:50:40 2021] GET /compute/v2.1/servers/e948b5ed-a647-4111-833a-61931190c520 => generated 1313 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 24 10:50:41.236970 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-68cb51ed-4841-4e0a-80f3-4243f4d38dbd tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc441b6f06b44beb2a85f854cf92dd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696f3d18f3af4e0eb5760d829e0c3977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:50:41.244214 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-68cb51ed-4841-4e0a-80f3-4243f4d38dbd tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] 10.222.0.30 "GET /compute/v2.1/servers/90bed19f-dc1d-408e-8520-34e390ac92cd" status: 200 len: 1318 microversion: 2.1 time: 0.431847 Dec 24 10:50:41.244781 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 451/894] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:50:40 2021] GET /compute/v2.1/servers/90bed19f-dc1d-408e-8520-34e390ac92cd => generated 1318 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:50:41.647835 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-c80538c4-4501-4ad7-939e-5c375fb17bb2 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:50:41.648744 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-c80538c4-4501-4ad7-939e-5c375fb17bb2 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] [instance: d2c0f276-f763-4337-a5dd-0c328c8c2e73] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:50:41.655968 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-c80538c4-4501-4ad7-939e-5c375fb17bb2 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:50:41.656408 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-c80538c4-4501-4ad7-939e-5c375fb17bb2 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:50:41.657214 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-c80538c4-4501-4ad7-939e-5c375fb17bb2 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:50:41.657641 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-c80538c4-4501-4ad7-939e-5c375fb17bb2 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:50:41.744401 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-c80538c4-4501-4ad7-939e-5c375fb17bb2 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] 10.222.0.30 "POST /compute/v2.1/servers/d2c0f276-f763-4337-a5dd-0c328c8c2e73/action" status: 200 len: 28890 microversion: 2.20 time: 0.100162 Dec 24 10:50:41.744959 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 444/895] 10.222.0.30 () {62 vars in 1318 bytes} [Fri Dec 24 10:50:41 2021] POST /compute/v2.1/servers/d2c0f276-f763-4337-a5dd-0c328c8c2e73/action => generated 28890 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 24 10:50:41.875444 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-d8170fc2-b7b1-4013-b203-ac89aae2d411 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-564071395", "imageRef": "fae8172d-77c4-4f40-905a-7285c185448c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "12a04c86-5d95-4704-a030-534aa0c4e8bc"}], "security_groups": [{"name": "tempest-securitygroup--1255893236"}], "key_name": "tempest-keypair-1139497446", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:50:41.982983 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.network.neutron [None req-d8170fc2-b7b1-4013-b203-ac89aae2d411 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] validate_networks() for [('12a04c86-5d95-4704-a030-534aa0c4e8bc', None, None, None, None, None)] {{(pid=123432) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 24 10:50:42.198037 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-236b4338-c411-4204-b127-3ac2eecf8f1b tempest-VolumesActionsTest-1489615802 tempest-VolumesActionsTest-1489615802-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:50:42.198759 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-236b4338-c411-4204-b127-3ac2eecf8f1b tempest-VolumesActionsTest-1489615802 tempest-VolumesActionsTest-1489615802-project] [instance: e948b5ed-a647-4111-833a-61931190c520] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:50:42.204949 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-236b4338-c411-4204-b127-3ac2eecf8f1b tempest-VolumesActionsTest-1489615802 tempest-VolumesActionsTest-1489615802-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:50:42.205395 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-236b4338-c411-4204-b127-3ac2eecf8f1b tempest-VolumesActionsTest-1489615802 tempest-VolumesActionsTest-1489615802-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:50:42.206165 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-236b4338-c411-4204-b127-3ac2eecf8f1b tempest-VolumesActionsTest-1489615802 tempest-VolumesActionsTest-1489615802-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:50:42.206599 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-236b4338-c411-4204-b127-3ac2eecf8f1b tempest-VolumesActionsTest-1489615802 tempest-VolumesActionsTest-1489615802-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:50:42.340459 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-236b4338-c411-4204-b127-3ac2eecf8f1b tempest-VolumesActionsTest-1489615802 tempest-VolumesActionsTest-1489615802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b484152f59664123bf8c9d4c56bfebb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8a5fd5e33e4d059b152730ca60d5c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:50:42.347045 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.virt.hardware [None req-d8170fc2-b7b1-4013-b203-ac89aae2d411 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Flavor limits 0:0:0 {{(pid=123432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 24 10:50:42.347461 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.virt.hardware [None req-d8170fc2-b7b1-4013-b203-ac89aae2d411 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Image limits 0:0:0 {{(pid=123432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 24 10:50:42.347654 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-236b4338-c411-4204-b127-3ac2eecf8f1b tempest-VolumesActionsTest-1489615802 tempest-VolumesActionsTest-1489615802-project] 10.222.0.30 "GET /compute/v2.1/servers/e948b5ed-a647-4111-833a-61931190c520" status: 200 len: 1496 microversion: 2.1 time: 0.153630 Dec 24 10:50:42.347927 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.virt.hardware [None req-d8170fc2-b7b1-4013-b203-ac89aae2d411 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Flavor pref 0:0:0 {{(pid=123432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 24 10:50:42.348231 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 445/896] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:50:42 2021] GET /compute/v2.1/servers/e948b5ed-a647-4111-833a-61931190c520 => generated 1496 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 24 10:50:42.348324 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.virt.hardware [None req-d8170fc2-b7b1-4013-b203-ac89aae2d411 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Image pref 0:0:0 {{(pid=123432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 24 10:50:42.348715 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.virt.hardware [None req-d8170fc2-b7b1-4013-b203-ac89aae2d411 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 24 10:50:42.358237 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-d8170fc2-b7b1-4013-b203-ac89aae2d411 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:50:42.358686 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-b4d07a78-745b-4941-b5c0-4f0eba4f161f tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:50:42.358812 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-d8170fc2-b7b1-4013-b203-ac89aae2d411 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:50:42.359286 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-b4d07a78-745b-4941-b5c0-4f0eba4f161f tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] [instance: 90bed19f-dc1d-408e-8520-34e390ac92cd] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:50:42.359800 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-d8170fc2-b7b1-4013-b203-ac89aae2d411 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:50:42.360312 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-d8170fc2-b7b1-4013-b203-ac89aae2d411 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:50:42.364968 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-b4d07a78-745b-4941-b5c0-4f0eba4f161f tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:50:42.365411 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-b4d07a78-745b-4941-b5c0-4f0eba4f161f tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:50:42.366185 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-b4d07a78-745b-4941-b5c0-4f0eba4f161f tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:50:42.366611 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-b4d07a78-745b-4941-b5c0-4f0eba4f161f tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:50:42.382826 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.quota [None req-d8170fc2-b7b1-4013-b203-ac89aae2d411 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Getting quotas for project 3f0115a5cc8b4b1e8bffb84e0f3e0b08. Resources: {'instances', 'cores', 'ram'} {{(pid=123432) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 24 10:50:42.387920 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.quota [None req-d8170fc2-b7b1-4013-b203-ac89aae2d411 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Getting quotas for user 37516225f9244c969ed168f6a024482a and project 3f0115a5cc8b4b1e8bffb84e0f3e0b08. Resources: {'instances', 'cores', 'ram'} {{(pid=123432) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 24 10:50:42.402211 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-d8170fc2-b7b1-4013-b203-ac89aae2d411 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Going to run 1 instances... {{(pid=123432) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 24 10:50:42.405364 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-d8170fc2-b7b1-4013-b203-ac89aae2d411 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] [instance: 1e267da4-1e48-4136-babc-656ccd50aae2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fae8172d-77c4-4f40-905a-7285c185448c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123432) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 24 10:50:42.507768 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-b4d07a78-745b-4941-b5c0-4f0eba4f161f tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc441b6f06b44beb2a85f854cf92dd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696f3d18f3af4e0eb5760d829e0c3977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:50:42.515952 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-b4d07a78-745b-4941-b5c0-4f0eba4f161f tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] 10.222.0.30 "GET /compute/v2.1/servers/90bed19f-dc1d-408e-8520-34e390ac92cd" status: 200 len: 1318 microversion: 2.1 time: 0.160606 Dec 24 10:50:42.516768 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 446/897] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:50:42 2021] GET /compute/v2.1/servers/90bed19f-dc1d-408e-8520-34e390ac92cd => generated 1318 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:50:42.522075 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-d8170fc2-b7b1-4013-b203-ac89aae2d411 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.650645 Dec 24 10:50:42.522974 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 452/898] 10.222.0.30 () {60 vars in 1146 bytes} [Fri Dec 24 10:50:41 2021] POST /compute/v2.1/servers => generated 402 bytes in 653 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 24 10:50:42.538235 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-2194cb63-d07d-4270-b60a-24b0dda6c26c tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:50:42.538958 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-2194cb63-d07d-4270-b60a-24b0dda6c26c tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] [instance: 1e267da4-1e48-4136-babc-656ccd50aae2] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:50:42.589600 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-2194cb63-d07d-4270-b60a-24b0dda6c26c tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37516225f9244c969ed168f6a024482a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0115a5cc8b4b1e8bffb84e0f3e0b08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:50:42.596236 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-2194cb63-d07d-4270-b60a-24b0dda6c26c tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] 10.222.0.30 "GET /compute/v2.1/servers/1e267da4-1e48-4136-babc-656ccd50aae2" status: 200 len: 1237 microversion: 2.1 time: 0.061888 Dec 24 10:50:42.596835 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 447/899] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:50:42 2021] GET /compute/v2.1/servers/1e267da4-1e48-4136-babc-656ccd50aae2 => generated 1237 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:50:42.755480 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-abc9af05-773f-4750-8556-5c33d49f098e tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:50:42.756387 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-abc9af05-773f-4750-8556-5c33d49f098e tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] [instance: d2c0f276-f763-4337-a5dd-0c328c8c2e73] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:50:42.763075 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-abc9af05-773f-4750-8556-5c33d49f098e tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:50:42.763521 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-abc9af05-773f-4750-8556-5c33d49f098e tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:50:42.764302 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-abc9af05-773f-4750-8556-5c33d49f098e tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:50:42.764734 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-abc9af05-773f-4750-8556-5c33d49f098e tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:50:42.839022 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-abc9af05-773f-4750-8556-5c33d49f098e tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] 10.222.0.30 "POST /compute/v2.1/servers/d2c0f276-f763-4337-a5dd-0c328c8c2e73/action" status: 200 len: 30826 microversion: 2.20 time: 0.087162 Dec 24 10:50:42.841029 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 453/900] 10.222.0.30 () {62 vars in 1318 bytes} [Fri Dec 24 10:50:42 2021] POST /compute/v2.1/servers/d2c0f276-f763-4337-a5dd-0c328c8c2e73/action => generated 30826 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 24 10:50:43.305591 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-de5746b9-20d2-4516-9dd7-fb490dce44ee tempest-VolumesActionsTest-1489615802 tempest-VolumesActionsTest-1489615802-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:50:43.306105 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-de5746b9-20d2-4516-9dd7-fb490dce44ee tempest-VolumesActionsTest-1489615802 tempest-VolumesActionsTest-1489615802-project] [instance: e948b5ed-a647-4111-833a-61931190c520] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:50:43.312411 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-de5746b9-20d2-4516-9dd7-fb490dce44ee tempest-VolumesActionsTest-1489615802 tempest-VolumesActionsTest-1489615802-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:50:43.312876 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-de5746b9-20d2-4516-9dd7-fb490dce44ee tempest-VolumesActionsTest-1489615802 tempest-VolumesActionsTest-1489615802-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:50:43.313643 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-de5746b9-20d2-4516-9dd7-fb490dce44ee tempest-VolumesActionsTest-1489615802 tempest-VolumesActionsTest-1489615802-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:50:43.314143 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-de5746b9-20d2-4516-9dd7-fb490dce44ee tempest-VolumesActionsTest-1489615802 tempest-VolumesActionsTest-1489615802-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:50:43.338144 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-de5746b9-20d2-4516-9dd7-fb490dce44ee tempest-VolumesActionsTest-1489615802 tempest-VolumesActionsTest-1489615802-project] [instance: e948b5ed-a647-4111-833a-61931190c520] Going to try to terminate instance {{(pid=123431) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 24 10:50:43.533712 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-3b99ddfe-7882-4fab-8b93-599bb12bb467 tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:50:43.534436 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-3b99ddfe-7882-4fab-8b93-599bb12bb467 tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] [instance: 90bed19f-dc1d-408e-8520-34e390ac92cd] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:50:43.541245 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-3b99ddfe-7882-4fab-8b93-599bb12bb467 tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:50:43.541711 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-3b99ddfe-7882-4fab-8b93-599bb12bb467 tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:50:43.543041 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-3b99ddfe-7882-4fab-8b93-599bb12bb467 tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:50:43.543473 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-3b99ddfe-7882-4fab-8b93-599bb12bb467 tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:50:43.676808 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-3b99ddfe-7882-4fab-8b93-599bb12bb467 tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc441b6f06b44beb2a85f854cf92dd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696f3d18f3af4e0eb5760d829e0c3977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:50:43.684057 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-3b99ddfe-7882-4fab-8b93-599bb12bb467 tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] 10.222.0.30 "GET /compute/v2.1/servers/90bed19f-dc1d-408e-8520-34e390ac92cd" status: 200 len: 1318 microversion: 2.1 time: 0.154494 Dec 24 10:50:43.684617 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 454/901] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:50:43 2021] GET /compute/v2.1/servers/90bed19f-dc1d-408e-8520-34e390ac92cd => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 24 10:50:43.689086 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-27393aad-13b4-4f0c-ae55-c6b41e33792a tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:50:43.689680 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-27393aad-13b4-4f0c-ae55-c6b41e33792a tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] [instance: 1e267da4-1e48-4136-babc-656ccd50aae2] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:50:43.695209 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-27393aad-13b4-4f0c-ae55-c6b41e33792a tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:50:43.695646 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-27393aad-13b4-4f0c-ae55-c6b41e33792a tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:50:43.696416 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-27393aad-13b4-4f0c-ae55-c6b41e33792a tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:50:43.696873 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-27393aad-13b4-4f0c-ae55-c6b41e33792a tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:50:43.705388 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-de5746b9-20d2-4516-9dd7-fb490dce44ee tempest-VolumesActionsTest-1489615802 tempest-VolumesActionsTest-1489615802-project] 10.222.0.30 "DELETE /compute/v2.1/servers/e948b5ed-a647-4111-833a-61931190c520" status: 204 len: 0 microversion: 2.1 time: 0.403149 Dec 24 10:50:43.706142 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 448/902] 10.222.0.30 () {58 vars in 1238 bytes} [Fri Dec 24 10:50:43 2021] DELETE /compute/v2.1/servers/e948b5ed-a647-4111-833a-61931190c520 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 24 10:50:43.718850 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-9d15e06d-0317-4217-9ff5-3da3843172a2 tempest-VolumesActionsTest-1489615802 tempest-VolumesActionsTest-1489615802-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:50:43.719633 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-9d15e06d-0317-4217-9ff5-3da3843172a2 tempest-VolumesActionsTest-1489615802 tempest-VolumesActionsTest-1489615802-project] [instance: e948b5ed-a647-4111-833a-61931190c520] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:50:43.725414 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-9d15e06d-0317-4217-9ff5-3da3843172a2 tempest-VolumesActionsTest-1489615802 tempest-VolumesActionsTest-1489615802-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:50:43.725935 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-9d15e06d-0317-4217-9ff5-3da3843172a2 tempest-VolumesActionsTest-1489615802 tempest-VolumesActionsTest-1489615802-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:50:43.726716 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-9d15e06d-0317-4217-9ff5-3da3843172a2 tempest-VolumesActionsTest-1489615802 tempest-VolumesActionsTest-1489615802-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:50:43.727145 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-9d15e06d-0317-4217-9ff5-3da3843172a2 tempest-VolumesActionsTest-1489615802 tempest-VolumesActionsTest-1489615802-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:50:43.756271 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-27393aad-13b4-4f0c-ae55-c6b41e33792a tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37516225f9244c969ed168f6a024482a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0115a5cc8b4b1e8bffb84e0f3e0b08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:50:43.764355 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-27393aad-13b4-4f0c-ae55-c6b41e33792a tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] 10.222.0.30 "GET /compute/v2.1/servers/1e267da4-1e48-4136-babc-656ccd50aae2" status: 200 len: 1241 microversion: 2.1 time: 0.078751 Dec 24 10:50:43.764936 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 455/903] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:50:43 2021] GET /compute/v2.1/servers/1e267da4-1e48-4136-babc-656ccd50aae2 => generated 1241 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:50:43.852160 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-456df930-4899-48b9-be5e-460be1749edc tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:50:43.853104 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-456df930-4899-48b9-be5e-460be1749edc tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] [instance: d2c0f276-f763-4337-a5dd-0c328c8c2e73] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:50:43.858447 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-9d15e06d-0317-4217-9ff5-3da3843172a2 tempest-VolumesActionsTest-1489615802 tempest-VolumesActionsTest-1489615802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b484152f59664123bf8c9d4c56bfebb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8a5fd5e33e4d059b152730ca60d5c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:50:43.859999 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-456df930-4899-48b9-be5e-460be1749edc tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:50:43.860438 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-456df930-4899-48b9-be5e-460be1749edc tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:50:43.861375 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-456df930-4899-48b9-be5e-460be1749edc tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:50:43.861811 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-456df930-4899-48b9-be5e-460be1749edc tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:50:43.867300 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-9d15e06d-0317-4217-9ff5-3da3843172a2 tempest-VolumesActionsTest-1489615802 tempest-VolumesActionsTest-1489615802-project] 10.222.0.30 "GET /compute/v2.1/servers/e948b5ed-a647-4111-833a-61931190c520" status: 200 len: 1502 microversion: 2.1 time: 0.152865 Dec 24 10:50:43.868381 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 449/904] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:50:43 2021] GET /compute/v2.1/servers/e948b5ed-a647-4111-833a-61931190c520 => generated 1502 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 24 10:50:43.948017 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-456df930-4899-48b9-be5e-460be1749edc tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] 10.222.0.30 "POST /compute/v2.1/servers/d2c0f276-f763-4337-a5dd-0c328c8c2e73/action" status: 200 len: 32652 microversion: 2.20 time: 0.099318 Dec 24 10:50:43.949286 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 456/905] 10.222.0.30 () {62 vars in 1318 bytes} [Fri Dec 24 10:50:43 2021] POST /compute/v2.1/servers/d2c0f276-f763-4337-a5dd-0c328c8c2e73/action => generated 32652 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 24 10:50:44.095972 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [req-1ac8bb22-8dd0-4399-8f2c-c249b929a439 req-d6286e48-cbee-4b9b-bf18-cf3efef208f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90bed19f-dc1d-408e-8520-34e390ac92cd", "name": "network-vif-plugged", "status": "completed", "tag": "0a1505e6-626c-4f03-8fa1-81e71b8f72d5"}]} {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:50:44.097510 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 10:50:44.097510 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: warnings.warn(msg) Dec 24 10:50:44.104324 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [req-1ac8bb22-8dd0-4399-8f2c-c249b929a439 req-d6286e48-cbee-4b9b-bf18-cf3efef208f6 service nova] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:50:44.104768 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [req-1ac8bb22-8dd0-4399-8f2c-c249b929a439 req-d6286e48-cbee-4b9b-bf18-cf3efef208f6 service nova] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:50:44.117209 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.compute.server_external_events [req-1ac8bb22-8dd0-4399-8f2c-c249b929a439 req-d6286e48-cbee-4b9b-bf18-cf3efef208f6 service nova] Creating event network-vif-plugged:0a1505e6-626c-4f03-8fa1-81e71b8f72d5 for instance 90bed19f-dc1d-408e-8520-34e390ac92cd on hv-cinder-81644 Dec 24 10:50:44.122875 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [req-1ac8bb22-8dd0-4399-8f2c-c249b929a439 req-d6286e48-cbee-4b9b-bf18-cf3efef208f6 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030182 Dec 24 10:50:44.122989 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 450/906] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Dec 24 10:50:44 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 10:50:44.700346 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-096ff300-a56d-4e7a-a452-71a5d952e5ce tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:50:44.701085 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-096ff300-a56d-4e7a-a452-71a5d952e5ce tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] [instance: 90bed19f-dc1d-408e-8520-34e390ac92cd] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:50:44.707916 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-096ff300-a56d-4e7a-a452-71a5d952e5ce tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:50:44.708362 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-096ff300-a56d-4e7a-a452-71a5d952e5ce tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:50:44.709171 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-096ff300-a56d-4e7a-a452-71a5d952e5ce tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:50:44.709603 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-096ff300-a56d-4e7a-a452-71a5d952e5ce tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:50:44.782317 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-d5785ed3-f4e5-41da-8e90-9243ec0345f9 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:50:44.782935 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-d5785ed3-f4e5-41da-8e90-9243ec0345f9 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] [instance: 1e267da4-1e48-4136-babc-656ccd50aae2] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:50:44.788955 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-d5785ed3-f4e5-41da-8e90-9243ec0345f9 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:50:44.789405 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-d5785ed3-f4e5-41da-8e90-9243ec0345f9 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:50:44.790180 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-d5785ed3-f4e5-41da-8e90-9243ec0345f9 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:50:44.790893 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-d5785ed3-f4e5-41da-8e90-9243ec0345f9 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:50:44.841994 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-096ff300-a56d-4e7a-a452-71a5d952e5ce tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc441b6f06b44beb2a85f854cf92dd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696f3d18f3af4e0eb5760d829e0c3977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:50:44.849243 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-096ff300-a56d-4e7a-a452-71a5d952e5ce tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] 10.222.0.30 "GET /compute/v2.1/servers/90bed19f-dc1d-408e-8520-34e390ac92cd" status: 200 len: 1318 microversion: 2.1 time: 0.152811 Dec 24 10:50:44.849811 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 457/907] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:50:44 2021] GET /compute/v2.1/servers/90bed19f-dc1d-408e-8520-34e390ac92cd => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:50:44.850329 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-d5785ed3-f4e5-41da-8e90-9243ec0345f9 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37516225f9244c969ed168f6a024482a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0115a5cc8b4b1e8bffb84e0f3e0b08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:50:44.858272 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-d5785ed3-f4e5-41da-8e90-9243ec0345f9 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] 10.222.0.30 "GET /compute/v2.1/servers/1e267da4-1e48-4136-babc-656ccd50aae2" status: 200 len: 1289 microversion: 2.1 time: 0.079978 Dec 24 10:50:44.858823 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 451/908] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:50:44 2021] GET /compute/v2.1/servers/1e267da4-1e48-4136-babc-656ccd50aae2 => generated 1289 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 24 10:50:44.890052 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-ae8a3682-96a0-4294-9dff-b6220c469bc3 tempest-VolumesActionsTest-1489615802 tempest-VolumesActionsTest-1489615802-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:50:44.890658 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-ae8a3682-96a0-4294-9dff-b6220c469bc3 tempest-VolumesActionsTest-1489615802 tempest-VolumesActionsTest-1489615802-project] [instance: e948b5ed-a647-4111-833a-61931190c520] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:50:44.896754 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-ae8a3682-96a0-4294-9dff-b6220c469bc3 tempest-VolumesActionsTest-1489615802 tempest-VolumesActionsTest-1489615802-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:50:44.897225 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-ae8a3682-96a0-4294-9dff-b6220c469bc3 tempest-VolumesActionsTest-1489615802 tempest-VolumesActionsTest-1489615802-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:50:44.898025 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-ae8a3682-96a0-4294-9dff-b6220c469bc3 tempest-VolumesActionsTest-1489615802 tempest-VolumesActionsTest-1489615802-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:50:44.898454 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-ae8a3682-96a0-4294-9dff-b6220c469bc3 tempest-VolumesActionsTest-1489615802 tempest-VolumesActionsTest-1489615802-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:50:44.959619 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-36f56a90-fadb-45b9-b91b-d0489f1f5aa4 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:50:44.960642 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-36f56a90-fadb-45b9-b91b-d0489f1f5aa4 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] [instance: d2c0f276-f763-4337-a5dd-0c328c8c2e73] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:50:44.966967 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-36f56a90-fadb-45b9-b91b-d0489f1f5aa4 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:50:44.967481 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-36f56a90-fadb-45b9-b91b-d0489f1f5aa4 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:50:44.968325 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-36f56a90-fadb-45b9-b91b-d0489f1f5aa4 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:50:44.968839 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-36f56a90-fadb-45b9-b91b-d0489f1f5aa4 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:50:45.028113 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-ae8a3682-96a0-4294-9dff-b6220c469bc3 tempest-VolumesActionsTest-1489615802 tempest-VolumesActionsTest-1489615802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b484152f59664123bf8c9d4c56bfebb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8a5fd5e33e4d059b152730ca60d5c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:50:45.035424 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-ae8a3682-96a0-4294-9dff-b6220c469bc3 tempest-VolumesActionsTest-1489615802 tempest-VolumesActionsTest-1489615802-project] 10.222.0.30 "GET /compute/v2.1/servers/e948b5ed-a647-4111-833a-61931190c520" status: 200 len: 1502 microversion: 2.1 time: 0.148992 Dec 24 10:50:45.035922 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 458/909] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:50:44 2021] GET /compute/v2.1/servers/e948b5ed-a647-4111-833a-61931190c520 => generated 1502 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:50:45.048123 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-36f56a90-fadb-45b9-b91b-d0489f1f5aa4 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] 10.222.0.30 "POST /compute/v2.1/servers/d2c0f276-f763-4337-a5dd-0c328c8c2e73/action" status: 200 len: 33554 microversion: 2.20 time: 0.092063 Dec 24 10:50:45.048768 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 452/910] 10.222.0.30 () {62 vars in 1318 bytes} [Fri Dec 24 10:50:44 2021] POST /compute/v2.1/servers/d2c0f276-f763-4337-a5dd-0c328c8c2e73/action => generated 33554 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 24 10:50:45.866444 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-705cfb8e-9788-4cb1-a1b7-de861941ed57 tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:50:45.867582 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-705cfb8e-9788-4cb1-a1b7-de861941ed57 tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] [instance: 90bed19f-dc1d-408e-8520-34e390ac92cd] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:50:45.875748 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-705cfb8e-9788-4cb1-a1b7-de861941ed57 tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:50:45.876698 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-705cfb8e-9788-4cb1-a1b7-de861941ed57 tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:50:45.878018 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-705cfb8e-9788-4cb1-a1b7-de861941ed57 tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:50:45.878687 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-705cfb8e-9788-4cb1-a1b7-de861941ed57 tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:50:45.892086 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-4588fda4-ef1f-410d-b3b6-ee53667f8daf tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:50:45.898203 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-4588fda4-ef1f-410d-b3b6-ee53667f8daf tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] [instance: 1e267da4-1e48-4136-babc-656ccd50aae2] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:50:45.916211 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-4588fda4-ef1f-410d-b3b6-ee53667f8daf tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:50:45.919934 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-4588fda4-ef1f-410d-b3b6-ee53667f8daf tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:50:45.921976 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-4588fda4-ef1f-410d-b3b6-ee53667f8daf tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:50:45.922746 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-4588fda4-ef1f-410d-b3b6-ee53667f8daf tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:50:46.002244 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-4588fda4-ef1f-410d-b3b6-ee53667f8daf tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37516225f9244c969ed168f6a024482a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0115a5cc8b4b1e8bffb84e0f3e0b08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:50:46.009676 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-4588fda4-ef1f-410d-b3b6-ee53667f8daf tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] 10.222.0.30 "GET /compute/v2.1/servers/1e267da4-1e48-4136-babc-656ccd50aae2" status: 200 len: 1295 microversion: 2.1 time: 0.138052 Dec 24 10:50:46.010250 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 453/911] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:50:45 2021] GET /compute/v2.1/servers/1e267da4-1e48-4136-babc-656ccd50aae2 => generated 1295 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 24 10:50:46.052064 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-18d2e1b5-b0a0-4b21-bd94-074ad8da7f94 tempest-VolumesActionsTest-1489615802 tempest-VolumesActionsTest-1489615802-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:50:46.052674 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-18d2e1b5-b0a0-4b21-bd94-074ad8da7f94 tempest-VolumesActionsTest-1489615802 tempest-VolumesActionsTest-1489615802-project] [instance: e948b5ed-a647-4111-833a-61931190c520] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:50:46.061525 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-18d2e1b5-b0a0-4b21-bd94-074ad8da7f94 tempest-VolumesActionsTest-1489615802 tempest-VolumesActionsTest-1489615802-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:50:46.061977 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-18d2e1b5-b0a0-4b21-bd94-074ad8da7f94 tempest-VolumesActionsTest-1489615802 tempest-VolumesActionsTest-1489615802-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:50:46.062772 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-18d2e1b5-b0a0-4b21-bd94-074ad8da7f94 tempest-VolumesActionsTest-1489615802 tempest-VolumesActionsTest-1489615802-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:50:46.063201 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-18d2e1b5-b0a0-4b21-bd94-074ad8da7f94 tempest-VolumesActionsTest-1489615802 tempest-VolumesActionsTest-1489615802-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:50:46.157324 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-705cfb8e-9788-4cb1-a1b7-de861941ed57 tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc441b6f06b44beb2a85f854cf92dd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696f3d18f3af4e0eb5760d829e0c3977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:50:46.170453 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-705cfb8e-9788-4cb1-a1b7-de861941ed57 tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] 10.222.0.30 "GET /compute/v2.1/servers/90bed19f-dc1d-408e-8520-34e390ac92cd" status: 200 len: 1318 microversion: 2.1 time: 0.307678 Dec 24 10:50:46.171340 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 459/912] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:50:45 2021] GET /compute/v2.1/servers/90bed19f-dc1d-408e-8520-34e390ac92cd => generated 1318 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:50:46.184692 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-da70f4e9-baed-40fe-9167-a432ac178f32 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:50:46.184692 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-da70f4e9-baed-40fe-9167-a432ac178f32 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] [instance: d2c0f276-f763-4337-a5dd-0c328c8c2e73] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:50:46.184692 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-da70f4e9-baed-40fe-9167-a432ac178f32 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:50:46.184692 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-da70f4e9-baed-40fe-9167-a432ac178f32 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:50:46.185096 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-da70f4e9-baed-40fe-9167-a432ac178f32 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:50:46.185096 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-da70f4e9-baed-40fe-9167-a432ac178f32 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:50:46.265843 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-da70f4e9-baed-40fe-9167-a432ac178f32 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] 10.222.0.30 "POST /compute/v2.1/servers/d2c0f276-f763-4337-a5dd-0c328c8c2e73/action" status: 200 len: 34239 microversion: 2.20 time: 0.093188 Dec 24 10:50:46.267294 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 460/913] 10.222.0.30 () {62 vars in 1318 bytes} [Fri Dec 24 10:50:46 2021] POST /compute/v2.1/servers/d2c0f276-f763-4337-a5dd-0c328c8c2e73/action => generated 34239 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 24 10:50:46.308595 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-18d2e1b5-b0a0-4b21-bd94-074ad8da7f94 tempest-VolumesActionsTest-1489615802 tempest-VolumesActionsTest-1489615802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b484152f59664123bf8c9d4c56bfebb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8a5fd5e33e4d059b152730ca60d5c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:50:46.316424 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-18d2e1b5-b0a0-4b21-bd94-074ad8da7f94 tempest-VolumesActionsTest-1489615802 tempest-VolumesActionsTest-1489615802-project] 10.222.0.30 "GET /compute/v2.1/servers/e948b5ed-a647-4111-833a-61931190c520" status: 200 len: 1502 microversion: 2.1 time: 0.267925 Dec 24 10:50:46.317119 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 454/914] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:50:46 2021] GET /compute/v2.1/servers/e948b5ed-a647-4111-833a-61931190c520 => generated 1502 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 24 10:50:46.479856 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [req-86158fce-a564-4fc3-82ff-89d10d85d516 req-13c50f3a-f3b6-4775-b4f3-7e0531f0ba1e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e948b5ed-a647-4111-833a-61931190c520", "name": "network-vif-deleted", "tag": "1d3853f2-81fb-48c7-99e2-a8e011c53321"}]} {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:50:46.481491 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 10:50:46.481491 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: warnings.warn(msg) Dec 24 10:50:46.488796 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [req-86158fce-a564-4fc3-82ff-89d10d85d516 req-13c50f3a-f3b6-4775-b4f3-7e0531f0ba1e service nova] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:50:46.489684 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [req-86158fce-a564-4fc3-82ff-89d10d85d516 req-13c50f3a-f3b6-4775-b4f3-7e0531f0ba1e service nova] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:50:46.504283 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.compute.server_external_events [req-86158fce-a564-4fc3-82ff-89d10d85d516 req-13c50f3a-f3b6-4775-b4f3-7e0531f0ba1e service nova] Creating event network-vif-deleted:1d3853f2-81fb-48c7-99e2-a8e011c53321 for instance e948b5ed-a647-4111-833a-61931190c520 on hv-cinder-81644 Dec 24 10:50:46.509153 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [req-86158fce-a564-4fc3-82ff-89d10d85d516 req-13c50f3a-f3b6-4775-b4f3-7e0531f0ba1e service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033061 Dec 24 10:50:46.513220 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 461/915] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Dec 24 10:50:46 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 10:50:47.027880 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-320e2b4a-bd86-4877-8480-8c11fa4e4d7e tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:50:47.028475 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-320e2b4a-bd86-4877-8480-8c11fa4e4d7e tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] [instance: 1e267da4-1e48-4136-babc-656ccd50aae2] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:50:47.035051 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-320e2b4a-bd86-4877-8480-8c11fa4e4d7e tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:50:47.035410 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-320e2b4a-bd86-4877-8480-8c11fa4e4d7e tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:50:47.036191 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-320e2b4a-bd86-4877-8480-8c11fa4e4d7e tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:50:47.036625 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-320e2b4a-bd86-4877-8480-8c11fa4e4d7e tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:50:47.182071 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [req-fe9c4888-c1b0-4a41-a80f-34adcb57623c req-22b6cba3-c8c4-41a2-817f-6da24555fa4a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1e267da4-1e48-4136-babc-656ccd50aae2", "tag": "77f6b8b9-344d-496a-a27c-ff476412f5e6"}]} {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:50:47.183684 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 10:50:47.183684 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: warnings.warn(msg) Dec 24 10:50:47.193201 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [req-fe9c4888-c1b0-4a41-a80f-34adcb57623c req-22b6cba3-c8c4-41a2-817f-6da24555fa4a service nova] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:50:47.194618 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [req-fe9c4888-c1b0-4a41-a80f-34adcb57623c req-22b6cba3-c8c4-41a2-817f-6da24555fa4a service nova] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:50:47.209195 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.compute.server_external_events [req-fe9c4888-c1b0-4a41-a80f-34adcb57623c req-22b6cba3-c8c4-41a2-817f-6da24555fa4a service nova] Creating event network-changed:77f6b8b9-344d-496a-a27c-ff476412f5e6 for instance 1e267da4-1e48-4136-babc-656ccd50aae2 on hv-cinder-81644 Dec 24 10:50:47.215352 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [req-fe9c4888-c1b0-4a41-a80f-34adcb57623c req-22b6cba3-c8c4-41a2-817f-6da24555fa4a service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039770 Dec 24 10:50:47.217266 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 462/916] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Dec 24 10:50:47 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 24 10:50:47.224199 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-34e8d645-9e15-40b5-9009-bb417c03e067 tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:50:47.225388 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-34e8d645-9e15-40b5-9009-bb417c03e067 tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] [instance: 90bed19f-dc1d-408e-8520-34e390ac92cd] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:50:47.237055 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-320e2b4a-bd86-4877-8480-8c11fa4e4d7e tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37516225f9244c969ed168f6a024482a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0115a5cc8b4b1e8bffb84e0f3e0b08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:50:47.243307 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-34e8d645-9e15-40b5-9009-bb417c03e067 tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:50:47.243405 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-34e8d645-9e15-40b5-9009-bb417c03e067 tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:50:47.244981 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-34e8d645-9e15-40b5-9009-bb417c03e067 tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:50:47.245424 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-34e8d645-9e15-40b5-9009-bb417c03e067 tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:50:47.246842 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-320e2b4a-bd86-4877-8480-8c11fa4e4d7e tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] 10.222.0.30 "GET /compute/v2.1/servers/1e267da4-1e48-4136-babc-656ccd50aae2" status: 200 len: 1363 microversion: 2.1 time: 0.223146 Dec 24 10:50:47.248338 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 455/917] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:50:47 2021] GET /compute/v2.1/servers/1e267da4-1e48-4136-babc-656ccd50aae2 => generated 1363 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:50:47.278513 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-8101f53b-935e-47d2-967e-2b8a9c49f196 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:50:47.281741 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-8101f53b-935e-47d2-967e-2b8a9c49f196 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] [instance: d2c0f276-f763-4337-a5dd-0c328c8c2e73] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:50:47.288653 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-8101f53b-935e-47d2-967e-2b8a9c49f196 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:50:47.289463 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-8101f53b-935e-47d2-967e-2b8a9c49f196 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:50:47.290473 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-8101f53b-935e-47d2-967e-2b8a9c49f196 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:50:47.291066 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-8101f53b-935e-47d2-967e-2b8a9c49f196 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:50:47.380741 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-8101f53b-935e-47d2-967e-2b8a9c49f196 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] 10.222.0.30 "POST /compute/v2.1/servers/d2c0f276-f763-4337-a5dd-0c328c8c2e73/action" status: 200 len: 35306 microversion: 2.20 time: 0.106664 Dec 24 10:50:47.386007 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 456/918] 10.222.0.30 () {62 vars in 1318 bytes} [Fri Dec 24 10:50:47 2021] POST /compute/v2.1/servers/d2c0f276-f763-4337-a5dd-0c328c8c2e73/action => generated 35306 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 24 10:50:47.391249 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-00c93274-f11a-4dcd-b55c-17da31014b14 tempest-VolumesActionsTest-1489615802 tempest-VolumesActionsTest-1489615802-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:50:47.391949 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-00c93274-f11a-4dcd-b55c-17da31014b14 tempest-VolumesActionsTest-1489615802 tempest-VolumesActionsTest-1489615802-project] [instance: e948b5ed-a647-4111-833a-61931190c520] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:50:47.399271 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-00c93274-f11a-4dcd-b55c-17da31014b14 tempest-VolumesActionsTest-1489615802 tempest-VolumesActionsTest-1489615802-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:50:47.399717 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-00c93274-f11a-4dcd-b55c-17da31014b14 tempest-VolumesActionsTest-1489615802 tempest-VolumesActionsTest-1489615802-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:50:47.400644 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-00c93274-f11a-4dcd-b55c-17da31014b14 tempest-VolumesActionsTest-1489615802 tempest-VolumesActionsTest-1489615802-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:50:47.401106 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-00c93274-f11a-4dcd-b55c-17da31014b14 tempest-VolumesActionsTest-1489615802 tempest-VolumesActionsTest-1489615802-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:50:47.402501 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-34e8d645-9e15-40b5-9009-bb417c03e067 tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc441b6f06b44beb2a85f854cf92dd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696f3d18f3af4e0eb5760d829e0c3977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:50:47.410244 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-34e8d645-9e15-40b5-9009-bb417c03e067 tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] 10.222.0.30 "GET /compute/v2.1/servers/90bed19f-dc1d-408e-8520-34e390ac92cd" status: 200 len: 1506 microversion: 2.1 time: 0.191592 Dec 24 10:50:47.411568 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 463/919] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:50:47 2021] GET /compute/v2.1/servers/90bed19f-dc1d-408e-8520-34e390ac92cd => generated 1506 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:50:47.444788 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-00c93274-f11a-4dcd-b55c-17da31014b14 tempest-VolumesActionsTest-1489615802 tempest-VolumesActionsTest-1489615802-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:50:47.445267 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-00c93274-f11a-4dcd-b55c-17da31014b14 tempest-VolumesActionsTest-1489615802 tempest-VolumesActionsTest-1489615802-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:50:47.445709 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.objects.instance [None req-00c93274-f11a-4dcd-b55c-17da31014b14 tempest-VolumesActionsTest-1489615802 tempest-VolumesActionsTest-1489615802-project] Lazy-loading 'fault' on Instance uuid e948b5ed-a647-4111-833a-61931190c520 {{(pid=123431) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 24 10:50:47.508081 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-00c93274-f11a-4dcd-b55c-17da31014b14 tempest-VolumesActionsTest-1489615802 tempest-VolumesActionsTest-1489615802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b484152f59664123bf8c9d4c56bfebb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8a5fd5e33e4d059b152730ca60d5c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:50:47.519263 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-00c93274-f11a-4dcd-b55c-17da31014b14 tempest-VolumesActionsTest-1489615802 tempest-VolumesActionsTest-1489615802-project] 10.222.0.30 "GET /compute/v2.1/servers/e948b5ed-a647-4111-833a-61931190c520" status: 200 len: 1303 microversion: 2.1 time: 0.131714 Dec 24 10:50:47.520954 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 457/920] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:50:47 2021] GET /compute/v2.1/servers/e948b5ed-a647-4111-833a-61931190c520 => generated 1303 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:50:48.263307 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-6d99d3d3-6847-440b-8905-7c0abcf1f0ec tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:50:48.263946 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-6d99d3d3-6847-440b-8905-7c0abcf1f0ec tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] [instance: 1e267da4-1e48-4136-babc-656ccd50aae2] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:50:48.270602 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-6d99d3d3-6847-440b-8905-7c0abcf1f0ec tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:50:48.271029 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-6d99d3d3-6847-440b-8905-7c0abcf1f0ec tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:50:48.271850 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-6d99d3d3-6847-440b-8905-7c0abcf1f0ec tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:50:48.272238 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-6d99d3d3-6847-440b-8905-7c0abcf1f0ec tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:50:48.392029 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-8fbe28d9-6fcf-467f-9038-e9c191b8c7ef tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:50:48.393323 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-8fbe28d9-6fcf-467f-9038-e9c191b8c7ef tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] [instance: d2c0f276-f763-4337-a5dd-0c328c8c2e73] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:50:48.399804 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-8fbe28d9-6fcf-467f-9038-e9c191b8c7ef tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:50:48.400258 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-8fbe28d9-6fcf-467f-9038-e9c191b8c7ef tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:50:48.400647 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-6d99d3d3-6847-440b-8905-7c0abcf1f0ec tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37516225f9244c969ed168f6a024482a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0115a5cc8b4b1e8bffb84e0f3e0b08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:50:48.401089 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-8fbe28d9-6fcf-467f-9038-e9c191b8c7ef tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:50:48.401531 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-8fbe28d9-6fcf-467f-9038-e9c191b8c7ef tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:50:48.408094 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-6d99d3d3-6847-440b-8905-7c0abcf1f0ec tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] 10.222.0.30 "GET /compute/v2.1/servers/1e267da4-1e48-4136-babc-656ccd50aae2" status: 200 len: 1363 microversion: 2.1 time: 0.148390 Dec 24 10:50:48.408670 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 464/921] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:50:48 2021] GET /compute/v2.1/servers/1e267da4-1e48-4136-babc-656ccd50aae2 => generated 1363 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:50:48.475974 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-8fbe28d9-6fcf-467f-9038-e9c191b8c7ef tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] 10.222.0.30 "POST /compute/v2.1/servers/d2c0f276-f763-4337-a5dd-0c328c8c2e73/action" status: 200 len: 36676 microversion: 2.20 time: 0.087514 Dec 24 10:50:48.476608 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 458/922] 10.222.0.30 () {62 vars in 1318 bytes} [Fri Dec 24 10:50:48 2021] POST /compute/v2.1/servers/d2c0f276-f763-4337-a5dd-0c328c8c2e73/action => generated 36676 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 24 10:50:48.535169 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-78c91817-e577-4da9-94b8-34316cc5040e tempest-VolumesActionsTest-1489615802 tempest-VolumesActionsTest-1489615802-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:50:48.535776 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-78c91817-e577-4da9-94b8-34316cc5040e tempest-VolumesActionsTest-1489615802 tempest-VolumesActionsTest-1489615802-project] [instance: e948b5ed-a647-4111-833a-61931190c520] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:50:48.542998 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-78c91817-e577-4da9-94b8-34316cc5040e tempest-VolumesActionsTest-1489615802 tempest-VolumesActionsTest-1489615802-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:50:48.543443 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-78c91817-e577-4da9-94b8-34316cc5040e tempest-VolumesActionsTest-1489615802 tempest-VolumesActionsTest-1489615802-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:50:48.544222 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-78c91817-e577-4da9-94b8-34316cc5040e tempest-VolumesActionsTest-1489615802 tempest-VolumesActionsTest-1489615802-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:50:48.544654 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-78c91817-e577-4da9-94b8-34316cc5040e tempest-VolumesActionsTest-1489615802 tempest-VolumesActionsTest-1489615802-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:50:48.557411 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.wsgi [None req-78c91817-e577-4da9-94b8-34316cc5040e tempest-VolumesActionsTest-1489615802 tempest-VolumesActionsTest-1489615802-project] HTTP exception thrown: Instance e948b5ed-a647-4111-833a-61931190c520 could not be found. Dec 24 10:50:48.557990 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-78c91817-e577-4da9-94b8-34316cc5040e tempest-VolumesActionsTest-1489615802 tempest-VolumesActionsTest-1489615802-project] Returning 404 to user: Instance e948b5ed-a647-4111-833a-61931190c520 could not be found. {{(pid=123432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 24 10:50:48.558795 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-78c91817-e577-4da9-94b8-34316cc5040e tempest-VolumesActionsTest-1489615802 tempest-VolumesActionsTest-1489615802-project] 10.222.0.30 "GET /compute/v2.1/servers/e948b5ed-a647-4111-833a-61931190c520" status: 404 len: 111 microversion: 2.1 time: 0.027436 Dec 24 10:50:48.559371 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 465/923] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:50:48 2021] GET /compute/v2.1/servers/e948b5ed-a647-4111-833a-61931190c520 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 24 10:50:48.674613 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-1be8f23b-68ae-452c-a927-7c7724d3c5e7 tempest-VolumesActionsTest-1489615802 tempest-VolumesActionsTest-1489615802-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-39083406", "imageRef": "fae8172d-77c4-4f40-905a-7285c185448c", "flavorRef": "452", "networks": [{"uuid": "76ae600f-f994-44b0-af72-4c73bd837846"}]}} {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:50:48.726209 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.network.neutron [None req-1be8f23b-68ae-452c-a927-7c7724d3c5e7 tempest-VolumesActionsTest-1489615802 tempest-VolumesActionsTest-1489615802-project] validate_networks() for [('76ae600f-f994-44b0-af72-4c73bd837846', None, None, None, None, None)] {{(pid=123431) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 24 10:50:49.166612 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.virt.hardware [None req-1be8f23b-68ae-452c-a927-7c7724d3c5e7 tempest-VolumesActionsTest-1489615802 tempest-VolumesActionsTest-1489615802-project] Flavor limits 0:0:0 {{(pid=123431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 24 10:50:49.167033 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.virt.hardware [None req-1be8f23b-68ae-452c-a927-7c7724d3c5e7 tempest-VolumesActionsTest-1489615802 tempest-VolumesActionsTest-1489615802-project] Image limits 0:0:0 {{(pid=123431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 24 10:50:49.167499 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.virt.hardware [None req-1be8f23b-68ae-452c-a927-7c7724d3c5e7 tempest-VolumesActionsTest-1489615802 tempest-VolumesActionsTest-1489615802-project] Flavor pref 0:0:0 {{(pid=123431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 24 10:50:49.167901 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.virt.hardware [None req-1be8f23b-68ae-452c-a927-7c7724d3c5e7 tempest-VolumesActionsTest-1489615802 tempest-VolumesActionsTest-1489615802-project] Image pref 0:0:0 {{(pid=123431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 24 10:50:49.168305 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.virt.hardware [None req-1be8f23b-68ae-452c-a927-7c7724d3c5e7 tempest-VolumesActionsTest-1489615802 tempest-VolumesActionsTest-1489615802-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 24 10:50:49.176787 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-1be8f23b-68ae-452c-a927-7c7724d3c5e7 tempest-VolumesActionsTest-1489615802 tempest-VolumesActionsTest-1489615802-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:50:49.177260 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-1be8f23b-68ae-452c-a927-7c7724d3c5e7 tempest-VolumesActionsTest-1489615802 tempest-VolumesActionsTest-1489615802-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:50:49.178063 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-1be8f23b-68ae-452c-a927-7c7724d3c5e7 tempest-VolumesActionsTest-1489615802 tempest-VolumesActionsTest-1489615802-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:50:49.178491 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-1be8f23b-68ae-452c-a927-7c7724d3c5e7 tempest-VolumesActionsTest-1489615802 tempest-VolumesActionsTest-1489615802-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:50:49.194698 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.quota [None req-1be8f23b-68ae-452c-a927-7c7724d3c5e7 tempest-VolumesActionsTest-1489615802 tempest-VolumesActionsTest-1489615802-project] Getting quotas for project 2c8a5fd5e33e4d059b152730ca60d5c9. Resources: {'instances', 'cores', 'ram'} {{(pid=123431) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 24 10:50:49.199063 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.quota [None req-1be8f23b-68ae-452c-a927-7c7724d3c5e7 tempest-VolumesActionsTest-1489615802 tempest-VolumesActionsTest-1489615802-project] Getting quotas for user b484152f59664123bf8c9d4c56bfebb6 and project 2c8a5fd5e33e4d059b152730ca60d5c9. Resources: {'instances', 'cores', 'ram'} {{(pid=123431) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 24 10:50:49.209885 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-1be8f23b-68ae-452c-a927-7c7724d3c5e7 tempest-VolumesActionsTest-1489615802 tempest-VolumesActionsTest-1489615802-project] Going to run 1 instances... {{(pid=123431) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 24 10:50:49.212231 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-1be8f23b-68ae-452c-a927-7c7724d3c5e7 tempest-VolumesActionsTest-1489615802 tempest-VolumesActionsTest-1489615802-project] [instance: cd7d5e17-d089-4ff3-8b8e-bb2cb460ce5f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fae8172d-77c4-4f40-905a-7285c185448c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123431) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 24 10:50:49.425060 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-d14aa195-edd2-46ec-9433-9ca0d045acfe tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:50:49.425680 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-d14aa195-edd2-46ec-9433-9ca0d045acfe tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] [instance: 1e267da4-1e48-4136-babc-656ccd50aae2] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:50:49.428467 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-1be8f23b-68ae-452c-a927-7c7724d3c5e7 tempest-VolumesActionsTest-1489615802 tempest-VolumesActionsTest-1489615802-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.757783 Dec 24 10:50:49.429731 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 459/924] 10.222.0.30 () {60 vars in 1146 bytes} [Fri Dec 24 10:50:48 2021] POST /compute/v2.1/servers => generated 380 bytes in 760 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 24 10:50:49.433713 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-d14aa195-edd2-46ec-9433-9ca0d045acfe tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:50:49.434163 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-d14aa195-edd2-46ec-9433-9ca0d045acfe tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:50:49.435249 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-d14aa195-edd2-46ec-9433-9ca0d045acfe tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:50:49.435692 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-d14aa195-edd2-46ec-9433-9ca0d045acfe tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:50:49.439087 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-cc2b26f9-5fa5-4a3d-ad8d-ca86c617127c tempest-VolumesActionsTest-1489615802 tempest-VolumesActionsTest-1489615802-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:50:49.439823 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-cc2b26f9-5fa5-4a3d-ad8d-ca86c617127c tempest-VolumesActionsTest-1489615802 tempest-VolumesActionsTest-1489615802-project] [instance: cd7d5e17-d089-4ff3-8b8e-bb2cb460ce5f] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:50:49.499194 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-cc2b26f9-5fa5-4a3d-ad8d-ca86c617127c tempest-VolumesActionsTest-1489615802 tempest-VolumesActionsTest-1489615802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b484152f59664123bf8c9d4c56bfebb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8a5fd5e33e4d059b152730ca60d5c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:50:49.506496 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-cc2b26f9-5fa5-4a3d-ad8d-ca86c617127c tempest-VolumesActionsTest-1489615802 tempest-VolumesActionsTest-1489615802-project] 10.222.0.30 "GET /compute/v2.1/servers/cd7d5e17-d089-4ff3-8b8e-bb2cb460ce5f" status: 200 len: 1212 microversion: 2.1 time: 0.070924 Dec 24 10:50:49.507523 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 460/925] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:50:49 2021] GET /compute/v2.1/servers/cd7d5e17-d089-4ff3-8b8e-bb2cb460ce5f => generated 1212 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 24 10:50:49.513871 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-9edc78da-2062-46fd-ba4d-b598b0756ed1 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:50:49.515037 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-9edc78da-2062-46fd-ba4d-b598b0756ed1 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] [instance: d2c0f276-f763-4337-a5dd-0c328c8c2e73] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:50:49.522734 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-9edc78da-2062-46fd-ba4d-b598b0756ed1 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:50:49.523413 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-9edc78da-2062-46fd-ba4d-b598b0756ed1 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:50:49.524308 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-9edc78da-2062-46fd-ba4d-b598b0756ed1 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:50:49.524900 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-9edc78da-2062-46fd-ba4d-b598b0756ed1 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:50:49.580486 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-d14aa195-edd2-46ec-9433-9ca0d045acfe tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37516225f9244c969ed168f6a024482a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0115a5cc8b4b1e8bffb84e0f3e0b08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:50:49.587690 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-d14aa195-edd2-46ec-9433-9ca0d045acfe tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] 10.222.0.30 "GET /compute/v2.1/servers/1e267da4-1e48-4136-babc-656ccd50aae2" status: 200 len: 1363 microversion: 2.1 time: 0.166203 Dec 24 10:50:49.588275 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 466/926] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:50:49 2021] GET /compute/v2.1/servers/1e267da4-1e48-4136-babc-656ccd50aae2 => generated 1363 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 24 10:50:49.602436 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-9edc78da-2062-46fd-ba4d-b598b0756ed1 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] 10.222.0.30 "POST /compute/v2.1/servers/d2c0f276-f763-4337-a5dd-0c328c8c2e73/action" status: 200 len: 37855 microversion: 2.20 time: 0.092913 Dec 24 10:50:49.603144 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 461/927] 10.222.0.30 () {62 vars in 1318 bytes} [Fri Dec 24 10:50:49 2021] POST /compute/v2.1/servers/d2c0f276-f763-4337-a5dd-0c328c8c2e73/action => generated 37855 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 24 10:50:50.524084 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-5ad3f160-fa4a-4d43-883d-e73ee1d9bf97 tempest-VolumesActionsTest-1489615802 tempest-VolumesActionsTest-1489615802-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:50:50.524733 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-5ad3f160-fa4a-4d43-883d-e73ee1d9bf97 tempest-VolumesActionsTest-1489615802 tempest-VolumesActionsTest-1489615802-project] [instance: cd7d5e17-d089-4ff3-8b8e-bb2cb460ce5f] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:50:50.531181 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-5ad3f160-fa4a-4d43-883d-e73ee1d9bf97 tempest-VolumesActionsTest-1489615802 tempest-VolumesActionsTest-1489615802-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:50:50.531671 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-5ad3f160-fa4a-4d43-883d-e73ee1d9bf97 tempest-VolumesActionsTest-1489615802 tempest-VolumesActionsTest-1489615802-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:50:50.532457 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-5ad3f160-fa4a-4d43-883d-e73ee1d9bf97 tempest-VolumesActionsTest-1489615802 tempest-VolumesActionsTest-1489615802-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:50:50.532934 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-5ad3f160-fa4a-4d43-883d-e73ee1d9bf97 tempest-VolumesActionsTest-1489615802 tempest-VolumesActionsTest-1489615802-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:50:50.593124 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-5ad3f160-fa4a-4d43-883d-e73ee1d9bf97 tempest-VolumesActionsTest-1489615802 tempest-VolumesActionsTest-1489615802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b484152f59664123bf8c9d4c56bfebb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8a5fd5e33e4d059b152730ca60d5c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:50:50.600459 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-5ad3f160-fa4a-4d43-883d-e73ee1d9bf97 tempest-VolumesActionsTest-1489615802 tempest-VolumesActionsTest-1489615802-project] 10.222.0.30 "GET /compute/v2.1/servers/cd7d5e17-d089-4ff3-8b8e-bb2cb460ce5f" status: 200 len: 1216 microversion: 2.1 time: 0.080147 Dec 24 10:50:50.601315 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 467/928] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:50:50 2021] GET /compute/v2.1/servers/cd7d5e17-d089-4ff3-8b8e-bb2cb460ce5f => generated 1216 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:50:50.606216 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-7d9fb53c-d1fe-49e2-9d5c-6cedbe042863 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:50:50.606917 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-7d9fb53c-d1fe-49e2-9d5c-6cedbe042863 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] [instance: 1e267da4-1e48-4136-babc-656ccd50aae2] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:50:50.613838 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-7d9fb53c-d1fe-49e2-9d5c-6cedbe042863 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:50:50.614293 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-7d9fb53c-d1fe-49e2-9d5c-6cedbe042863 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:50:50.615088 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-7d9fb53c-d1fe-49e2-9d5c-6cedbe042863 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:50:50.615526 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-7d9fb53c-d1fe-49e2-9d5c-6cedbe042863 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:50:50.616173 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-7e24a2ed-6729-49c1-b29a-9e538d229117 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:50:50.617266 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-7e24a2ed-6729-49c1-b29a-9e538d229117 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] [instance: d2c0f276-f763-4337-a5dd-0c328c8c2e73] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:50:50.624226 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-7e24a2ed-6729-49c1-b29a-9e538d229117 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:50:50.624680 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-7e24a2ed-6729-49c1-b29a-9e538d229117 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:50:50.625636 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-7e24a2ed-6729-49c1-b29a-9e538d229117 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:50:50.626186 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-7e24a2ed-6729-49c1-b29a-9e538d229117 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:50:50.705106 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-7e24a2ed-6729-49c1-b29a-9e538d229117 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] 10.222.0.30 "POST /compute/v2.1/servers/d2c0f276-f763-4337-a5dd-0c328c8c2e73/action" status: 200 len: 38279 microversion: 2.20 time: 0.093389 Dec 24 10:50:50.705766 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 468/929] 10.222.0.30 () {62 vars in 1318 bytes} [Fri Dec 24 10:50:50 2021] POST /compute/v2.1/servers/d2c0f276-f763-4337-a5dd-0c328c8c2e73/action => generated 38279 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 24 10:50:50.749582 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-7d9fb53c-d1fe-49e2-9d5c-6cedbe042863 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37516225f9244c969ed168f6a024482a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0115a5cc8b4b1e8bffb84e0f3e0b08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:50:50.756647 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-7d9fb53c-d1fe-49e2-9d5c-6cedbe042863 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] 10.222.0.30 "GET /compute/v2.1/servers/1e267da4-1e48-4136-babc-656ccd50aae2" status: 200 len: 1363 microversion: 2.1 time: 0.155724 Dec 24 10:50:50.757243 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 462/930] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:50:50 2021] GET /compute/v2.1/servers/1e267da4-1e48-4136-babc-656ccd50aae2 => generated 1363 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 24 10:50:51.617254 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-d6ac25e6-35c2-49d7-8a26-cd7ae38268a3 tempest-VolumesActionsTest-1489615802 tempest-VolumesActionsTest-1489615802-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:50:51.617952 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-d6ac25e6-35c2-49d7-8a26-cd7ae38268a3 tempest-VolumesActionsTest-1489615802 tempest-VolumesActionsTest-1489615802-project] [instance: cd7d5e17-d089-4ff3-8b8e-bb2cb460ce5f] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:50:51.624874 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-d6ac25e6-35c2-49d7-8a26-cd7ae38268a3 tempest-VolumesActionsTest-1489615802 tempest-VolumesActionsTest-1489615802-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:50:51.625331 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-d6ac25e6-35c2-49d7-8a26-cd7ae38268a3 tempest-VolumesActionsTest-1489615802 tempest-VolumesActionsTest-1489615802-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:50:51.626118 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-d6ac25e6-35c2-49d7-8a26-cd7ae38268a3 tempest-VolumesActionsTest-1489615802 tempest-VolumesActionsTest-1489615802-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:50:51.626553 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-d6ac25e6-35c2-49d7-8a26-cd7ae38268a3 tempest-VolumesActionsTest-1489615802 tempest-VolumesActionsTest-1489615802-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:50:51.696104 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-d6ac25e6-35c2-49d7-8a26-cd7ae38268a3 tempest-VolumesActionsTest-1489615802 tempest-VolumesActionsTest-1489615802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b484152f59664123bf8c9d4c56bfebb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8a5fd5e33e4d059b152730ca60d5c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:50:51.703692 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-d6ac25e6-35c2-49d7-8a26-cd7ae38268a3 tempest-VolumesActionsTest-1489615802 tempest-VolumesActionsTest-1489615802-project] 10.222.0.30 "GET /compute/v2.1/servers/cd7d5e17-d089-4ff3-8b8e-bb2cb460ce5f" status: 200 len: 1272 microversion: 2.1 time: 0.090435 Dec 24 10:50:51.704245 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 469/931] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:50:51 2021] GET /compute/v2.1/servers/cd7d5e17-d089-4ff3-8b8e-bb2cb460ce5f => generated 1272 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:50:51.717005 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-e9324229-5afa-4989-85b2-e9ee27e7bc9e tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:50:51.717945 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-e9324229-5afa-4989-85b2-e9ee27e7bc9e tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] [instance: d2c0f276-f763-4337-a5dd-0c328c8c2e73] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:50:51.724119 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-e9324229-5afa-4989-85b2-e9ee27e7bc9e tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:50:51.724558 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-e9324229-5afa-4989-85b2-e9ee27e7bc9e tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:50:51.725371 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-e9324229-5afa-4989-85b2-e9ee27e7bc9e tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:50:51.725806 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-e9324229-5afa-4989-85b2-e9ee27e7bc9e tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:50:51.773646 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-e6d37f1c-1b54-43b8-9f52-5c479fc3b209 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:50:51.774250 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-e6d37f1c-1b54-43b8-9f52-5c479fc3b209 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] [instance: 1e267da4-1e48-4136-babc-656ccd50aae2] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:50:51.781102 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-e6d37f1c-1b54-43b8-9f52-5c479fc3b209 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:50:51.781579 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-e6d37f1c-1b54-43b8-9f52-5c479fc3b209 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:50:51.782433 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-e6d37f1c-1b54-43b8-9f52-5c479fc3b209 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:50:51.782867 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-e6d37f1c-1b54-43b8-9f52-5c479fc3b209 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:50:51.791203 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-e9324229-5afa-4989-85b2-e9ee27e7bc9e tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] 10.222.0.30 "POST /compute/v2.1/servers/d2c0f276-f763-4337-a5dd-0c328c8c2e73/action" status: 200 len: 38279 microversion: 2.20 time: 0.078246 Dec 24 10:50:51.792123 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 463/932] 10.222.0.30 () {62 vars in 1318 bytes} [Fri Dec 24 10:50:51 2021] POST /compute/v2.1/servers/d2c0f276-f763-4337-a5dd-0c328c8c2e73/action => generated 38279 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 24 10:50:51.929673 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-e6d37f1c-1b54-43b8-9f52-5c479fc3b209 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37516225f9244c969ed168f6a024482a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0115a5cc8b4b1e8bffb84e0f3e0b08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:50:51.939115 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-e6d37f1c-1b54-43b8-9f52-5c479fc3b209 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] 10.222.0.30 "GET /compute/v2.1/servers/1e267da4-1e48-4136-babc-656ccd50aae2" status: 200 len: 1363 microversion: 2.1 time: 0.170038 Dec 24 10:50:51.939701 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 470/933] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:50:51 2021] GET /compute/v2.1/servers/1e267da4-1e48-4136-babc-656ccd50aae2 => generated 1363 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 24 10:50:52.722655 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-8d058d2a-87a7-482d-98be-379c13c287d1 tempest-VolumesActionsTest-1489615802 tempest-VolumesActionsTest-1489615802-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:50:52.723609 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-8d058d2a-87a7-482d-98be-379c13c287d1 tempest-VolumesActionsTest-1489615802 tempest-VolumesActionsTest-1489615802-project] [instance: cd7d5e17-d089-4ff3-8b8e-bb2cb460ce5f] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:50:52.731514 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-8d058d2a-87a7-482d-98be-379c13c287d1 tempest-VolumesActionsTest-1489615802 tempest-VolumesActionsTest-1489615802-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:50:52.731989 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-8d058d2a-87a7-482d-98be-379c13c287d1 tempest-VolumesActionsTest-1489615802 tempest-VolumesActionsTest-1489615802-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:50:52.732767 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-8d058d2a-87a7-482d-98be-379c13c287d1 tempest-VolumesActionsTest-1489615802 tempest-VolumesActionsTest-1489615802-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:50:52.733219 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-8d058d2a-87a7-482d-98be-379c13c287d1 tempest-VolumesActionsTest-1489615802 tempest-VolumesActionsTest-1489615802-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:50:52.803480 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-209172b9-689e-4edd-8517-fc75443c1aec tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:50:52.804380 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-209172b9-689e-4edd-8517-fc75443c1aec tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] [instance: d2c0f276-f763-4337-a5dd-0c328c8c2e73] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:50:52.811287 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-209172b9-689e-4edd-8517-fc75443c1aec tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:50:52.812925 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-209172b9-689e-4edd-8517-fc75443c1aec tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:50:52.812925 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-209172b9-689e-4edd-8517-fc75443c1aec tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:50:52.813131 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-209172b9-689e-4edd-8517-fc75443c1aec tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:50:52.886812 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-209172b9-689e-4edd-8517-fc75443c1aec tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] 10.222.0.30 "POST /compute/v2.1/servers/d2c0f276-f763-4337-a5dd-0c328c8c2e73/action" status: 200 len: 38279 microversion: 2.20 time: 0.086696 Dec 24 10:50:52.887505 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 471/934] 10.222.0.30 () {62 vars in 1318 bytes} [Fri Dec 24 10:50:52 2021] POST /compute/v2.1/servers/d2c0f276-f763-4337-a5dd-0c328c8c2e73/action => generated 38279 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 24 10:50:52.962356 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-f431398d-a51b-4341-ada7-cfe4ce931c3b tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:50:52.962982 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-f431398d-a51b-4341-ada7-cfe4ce931c3b tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] [instance: 1e267da4-1e48-4136-babc-656ccd50aae2] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:50:52.969955 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-f431398d-a51b-4341-ada7-cfe4ce931c3b tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:50:52.970406 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-f431398d-a51b-4341-ada7-cfe4ce931c3b tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:50:52.971199 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-f431398d-a51b-4341-ada7-cfe4ce931c3b tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:50:52.971637 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-f431398d-a51b-4341-ada7-cfe4ce931c3b tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:50:52.988581 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-8d058d2a-87a7-482d-98be-379c13c287d1 tempest-VolumesActionsTest-1489615802 tempest-VolumesActionsTest-1489615802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b484152f59664123bf8c9d4c56bfebb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8a5fd5e33e4d059b152730ca60d5c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:50:52.998051 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-8d058d2a-87a7-482d-98be-379c13c287d1 tempest-VolumesActionsTest-1489615802 tempest-VolumesActionsTest-1489615802-project] 10.222.0.30 "GET /compute/v2.1/servers/cd7d5e17-d089-4ff3-8b8e-bb2cb460ce5f" status: 200 len: 1312 microversion: 2.1 time: 0.280452 Dec 24 10:50:52.998829 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 464/935] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:50:52 2021] GET /compute/v2.1/servers/cd7d5e17-d089-4ff3-8b8e-bb2cb460ce5f => generated 1312 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:50:53.106086 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-f431398d-a51b-4341-ada7-cfe4ce931c3b tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37516225f9244c969ed168f6a024482a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0115a5cc8b4b1e8bffb84e0f3e0b08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:50:53.113379 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-f431398d-a51b-4341-ada7-cfe4ce931c3b tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] 10.222.0.30 "GET /compute/v2.1/servers/1e267da4-1e48-4136-babc-656ccd50aae2" status: 200 len: 1363 microversion: 2.1 time: 0.160922 Dec 24 10:50:53.114026 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 472/936] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:50:52 2021] GET /compute/v2.1/servers/1e267da4-1e48-4136-babc-656ccd50aae2 => generated 1363 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:50:53.544310 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [req-ecf884d8-e5a2-443f-ac33-62e95e2f3e85 req-53865098-98ed-4f7a-8e7c-cea76bf87da6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cd7d5e17-d089-4ff3-8b8e-bb2cb460ce5f", "tag": "f7f94f7c-037f-4b6a-8285-ce790ac9221c"}]} {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:50:53.545913 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 10:50:53.545913 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: warnings.warn(msg) Dec 24 10:50:53.554769 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [req-ecf884d8-e5a2-443f-ac33-62e95e2f3e85 req-53865098-98ed-4f7a-8e7c-cea76bf87da6 service nova] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:50:53.558902 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [req-ecf884d8-e5a2-443f-ac33-62e95e2f3e85 req-53865098-98ed-4f7a-8e7c-cea76bf87da6 service nova] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:50:53.574655 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.compute.server_external_events [req-ecf884d8-e5a2-443f-ac33-62e95e2f3e85 req-53865098-98ed-4f7a-8e7c-cea76bf87da6 service nova] Creating event network-changed:f7f94f7c-037f-4b6a-8285-ce790ac9221c for instance cd7d5e17-d089-4ff3-8b8e-bb2cb460ce5f on hv-cinder-81644 Dec 24 10:50:53.579583 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [req-ecf884d8-e5a2-443f-ac33-62e95e2f3e85 req-53865098-98ed-4f7a-8e7c-cea76bf87da6 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038870 Dec 24 10:50:53.580203 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 465/937] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Dec 24 10:50:53 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 10:50:53.899266 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-b97e476f-4d5f-4eea-ba44-2ca0f4fc89d0 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:50:53.900206 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-b97e476f-4d5f-4eea-ba44-2ca0f4fc89d0 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] [instance: d2c0f276-f763-4337-a5dd-0c328c8c2e73] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:50:53.907821 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-b97e476f-4d5f-4eea-ba44-2ca0f4fc89d0 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:50:53.908268 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-b97e476f-4d5f-4eea-ba44-2ca0f4fc89d0 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:50:53.909085 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-b97e476f-4d5f-4eea-ba44-2ca0f4fc89d0 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:50:53.909519 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-b97e476f-4d5f-4eea-ba44-2ca0f4fc89d0 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:50:53.995461 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-b97e476f-4d5f-4eea-ba44-2ca0f4fc89d0 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] 10.222.0.30 "POST /compute/v2.1/servers/d2c0f276-f763-4337-a5dd-0c328c8c2e73/action" status: 200 len: 38422 microversion: 2.20 time: 0.099650 Dec 24 10:50:53.998282 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 473/938] 10.222.0.30 () {62 vars in 1318 bytes} [Fri Dec 24 10:50:53 2021] POST /compute/v2.1/servers/d2c0f276-f763-4337-a5dd-0c328c8c2e73/action => generated 38422 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 24 10:50:54.006985 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-11bb7b9e-a47b-4694-a4f8-285586de4807 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:50:54.007851 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-11bb7b9e-a47b-4694-a4f8-285586de4807 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] [instance: d2c0f276-f763-4337-a5dd-0c328c8c2e73] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:50:54.014531 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-11bb7b9e-a47b-4694-a4f8-285586de4807 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:50:54.015269 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-11bb7b9e-a47b-4694-a4f8-285586de4807 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:50:54.016260 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-11bb7b9e-a47b-4694-a4f8-285586de4807 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:50:54.016976 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-11bb7b9e-a47b-4694-a4f8-285586de4807 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:50:54.018259 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-79de8ebe-8e18-4981-a601-ab57bd65a9ec tempest-VolumesActionsTest-1489615802 tempest-VolumesActionsTest-1489615802-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:50:54.019282 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-79de8ebe-8e18-4981-a601-ab57bd65a9ec tempest-VolumesActionsTest-1489615802 tempest-VolumesActionsTest-1489615802-project] [instance: cd7d5e17-d089-4ff3-8b8e-bb2cb460ce5f] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:50:54.027722 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-79de8ebe-8e18-4981-a601-ab57bd65a9ec tempest-VolumesActionsTest-1489615802 tempest-VolumesActionsTest-1489615802-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:50:54.028178 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-79de8ebe-8e18-4981-a601-ab57bd65a9ec tempest-VolumesActionsTest-1489615802 tempest-VolumesActionsTest-1489615802-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:50:54.029176 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-79de8ebe-8e18-4981-a601-ab57bd65a9ec tempest-VolumesActionsTest-1489615802 tempest-VolumesActionsTest-1489615802-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:50:54.029967 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-79de8ebe-8e18-4981-a601-ab57bd65a9ec tempest-VolumesActionsTest-1489615802 tempest-VolumesActionsTest-1489615802-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:50:54.048722 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-11bb7b9e-a47b-4694-a4f8-285586de4807 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] 10.222.0.30 "GET /compute/v2.1/servers/d2c0f276-f763-4337-a5dd-0c328c8c2e73/ips" status: 200 len: 151 microversion: 2.20 time: 0.045985 Dec 24 10:50:54.049686 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 466/939] 10.222.0.30 () {60 vars in 1288 bytes} [Fri Dec 24 10:50:54 2021] GET /compute/v2.1/servers/d2c0f276-f763-4337-a5dd-0c328c8c2e73/ips => generated 151 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 24 10:50:54.126031 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [req-d145f080-f36f-4d53-a74f-3b3eb35829ef req-3c6c139b-8376-46f4-90a9-34f5157de18e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e267da4-1e48-4136-babc-656ccd50aae2", "name": "network-vif-plugged", "status": "completed", "tag": "77f6b8b9-344d-496a-a27c-ff476412f5e6"}]} {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:50:54.129283 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 10:50:54.129283 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: warnings.warn(msg) Dec 24 10:50:54.137562 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [req-d145f080-f36f-4d53-a74f-3b3eb35829ef req-3c6c139b-8376-46f4-90a9-34f5157de18e service nova] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:50:54.153327 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [req-d145f080-f36f-4d53-a74f-3b3eb35829ef req-3c6c139b-8376-46f4-90a9-34f5157de18e service nova] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:50:54.159910 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.compute.server_external_events [req-d145f080-f36f-4d53-a74f-3b3eb35829ef req-3c6c139b-8376-46f4-90a9-34f5157de18e service nova] Creating event network-vif-plugged:77f6b8b9-344d-496a-a27c-ff476412f5e6 for instance 1e267da4-1e48-4136-babc-656ccd50aae2 on hv-cinder-81644 Dec 24 10:50:54.164860 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [req-d145f080-f36f-4d53-a74f-3b3eb35829ef req-3c6c139b-8376-46f4-90a9-34f5157de18e service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047034 Dec 24 10:50:54.169991 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 467/940] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Dec 24 10:50:54 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 10:50:54.175313 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-8ac0ac08-e66e-4fea-b717-5639c8813a53 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:50:54.176272 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-8ac0ac08-e66e-4fea-b717-5639c8813a53 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] [instance: 1e267da4-1e48-4136-babc-656ccd50aae2] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:50:54.182838 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-8ac0ac08-e66e-4fea-b717-5639c8813a53 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:50:54.183546 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-8ac0ac08-e66e-4fea-b717-5639c8813a53 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:50:54.184579 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-8ac0ac08-e66e-4fea-b717-5639c8813a53 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:50:54.185205 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-8ac0ac08-e66e-4fea-b717-5639c8813a53 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:50:54.236836 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-79de8ebe-8e18-4981-a601-ab57bd65a9ec tempest-VolumesActionsTest-1489615802 tempest-VolumesActionsTest-1489615802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b484152f59664123bf8c9d4c56bfebb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8a5fd5e33e4d059b152730ca60d5c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:50:54.246183 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-79de8ebe-8e18-4981-a601-ab57bd65a9ec tempest-VolumesActionsTest-1489615802 tempest-VolumesActionsTest-1489615802-project] 10.222.0.30 "GET /compute/v2.1/servers/cd7d5e17-d089-4ff3-8b8e-bb2cb460ce5f" status: 200 len: 1312 microversion: 2.1 time: 0.234939 Dec 24 10:50:54.247002 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 474/941] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:50:54 2021] GET /compute/v2.1/servers/cd7d5e17-d089-4ff3-8b8e-bb2cb460ce5f => generated 1312 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:50:54.413804 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-8ac0ac08-e66e-4fea-b717-5639c8813a53 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37516225f9244c969ed168f6a024482a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0115a5cc8b4b1e8bffb84e0f3e0b08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:50:54.421454 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-8ac0ac08-e66e-4fea-b717-5639c8813a53 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] 10.222.0.30 "GET /compute/v2.1/servers/1e267da4-1e48-4136-babc-656ccd50aae2" status: 200 len: 1363 microversion: 2.1 time: 0.250155 Dec 24 10:50:54.422008 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 468/942] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:50:54 2021] GET /compute/v2.1/servers/1e267da4-1e48-4136-babc-656ccd50aae2 => generated 1363 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:50:55.263276 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-1d20697f-e6a4-4f85-92a7-5ed5394e9f41 tempest-VolumesActionsTest-1489615802 tempest-VolumesActionsTest-1489615802-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:50:55.263903 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-1d20697f-e6a4-4f85-92a7-5ed5394e9f41 tempest-VolumesActionsTest-1489615802 tempest-VolumesActionsTest-1489615802-project] [instance: cd7d5e17-d089-4ff3-8b8e-bb2cb460ce5f] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:50:55.270413 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-1d20697f-e6a4-4f85-92a7-5ed5394e9f41 tempest-VolumesActionsTest-1489615802 tempest-VolumesActionsTest-1489615802-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:50:55.270856 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-1d20697f-e6a4-4f85-92a7-5ed5394e9f41 tempest-VolumesActionsTest-1489615802 tempest-VolumesActionsTest-1489615802-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:50:55.271630 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-1d20697f-e6a4-4f85-92a7-5ed5394e9f41 tempest-VolumesActionsTest-1489615802 tempest-VolumesActionsTest-1489615802-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:50:55.272053 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-1d20697f-e6a4-4f85-92a7-5ed5394e9f41 tempest-VolumesActionsTest-1489615802 tempest-VolumesActionsTest-1489615802-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:50:55.415502 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-1d20697f-e6a4-4f85-92a7-5ed5394e9f41 tempest-VolumesActionsTest-1489615802 tempest-VolumesActionsTest-1489615802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b484152f59664123bf8c9d4c56bfebb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8a5fd5e33e4d059b152730ca60d5c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:50:55.423148 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-1d20697f-e6a4-4f85-92a7-5ed5394e9f41 tempest-VolumesActionsTest-1489615802 tempest-VolumesActionsTest-1489615802-project] 10.222.0.30 "GET /compute/v2.1/servers/cd7d5e17-d089-4ff3-8b8e-bb2cb460ce5f" status: 200 len: 1312 microversion: 2.1 time: 0.164312 Dec 24 10:50:55.423716 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 475/943] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:50:55 2021] GET /compute/v2.1/servers/cd7d5e17-d089-4ff3-8b8e-bb2cb460ce5f => generated 1312 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:50:55.438119 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-4e29cc4f-31e6-484f-b076-fcf954077540 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:50:55.438716 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-4e29cc4f-31e6-484f-b076-fcf954077540 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] [instance: 1e267da4-1e48-4136-babc-656ccd50aae2] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:50:55.444538 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-4e29cc4f-31e6-484f-b076-fcf954077540 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:50:55.445014 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-4e29cc4f-31e6-484f-b076-fcf954077540 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:50:55.445779 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-4e29cc4f-31e6-484f-b076-fcf954077540 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:50:55.446201 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-4e29cc4f-31e6-484f-b076-fcf954077540 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:50:55.579488 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-4e29cc4f-31e6-484f-b076-fcf954077540 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37516225f9244c969ed168f6a024482a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0115a5cc8b4b1e8bffb84e0f3e0b08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:50:55.586624 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-4e29cc4f-31e6-484f-b076-fcf954077540 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] 10.222.0.30 "GET /compute/v2.1/servers/1e267da4-1e48-4136-babc-656ccd50aae2" status: 200 len: 1363 microversion: 2.1 time: 0.152130 Dec 24 10:50:55.587183 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 469/944] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:50:55 2021] GET /compute/v2.1/servers/1e267da4-1e48-4136-babc-656ccd50aae2 => generated 1363 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:50:56.440869 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-f3907f6b-a06d-4085-aa22-6e5f0d2293be tempest-VolumesActionsTest-1489615802 tempest-VolumesActionsTest-1489615802-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:50:56.441517 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-f3907f6b-a06d-4085-aa22-6e5f0d2293be tempest-VolumesActionsTest-1489615802 tempest-VolumesActionsTest-1489615802-project] [instance: cd7d5e17-d089-4ff3-8b8e-bb2cb460ce5f] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:50:56.448487 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-f3907f6b-a06d-4085-aa22-6e5f0d2293be tempest-VolumesActionsTest-1489615802 tempest-VolumesActionsTest-1489615802-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:50:56.449246 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-f3907f6b-a06d-4085-aa22-6e5f0d2293be tempest-VolumesActionsTest-1489615802 tempest-VolumesActionsTest-1489615802-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:50:56.449760 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-f3907f6b-a06d-4085-aa22-6e5f0d2293be tempest-VolumesActionsTest-1489615802 tempest-VolumesActionsTest-1489615802-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:50:56.450217 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-f3907f6b-a06d-4085-aa22-6e5f0d2293be tempest-VolumesActionsTest-1489615802 tempest-VolumesActionsTest-1489615802-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:50:56.584366 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-f3907f6b-a06d-4085-aa22-6e5f0d2293be tempest-VolumesActionsTest-1489615802 tempest-VolumesActionsTest-1489615802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b484152f59664123bf8c9d4c56bfebb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8a5fd5e33e4d059b152730ca60d5c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:50:56.591642 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-f3907f6b-a06d-4085-aa22-6e5f0d2293be tempest-VolumesActionsTest-1489615802 tempest-VolumesActionsTest-1489615802-project] 10.222.0.30 "GET /compute/v2.1/servers/cd7d5e17-d089-4ff3-8b8e-bb2cb460ce5f" status: 200 len: 1312 microversion: 2.1 time: 0.154477 Dec 24 10:50:56.592209 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 476/945] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:50:56 2021] GET /compute/v2.1/servers/cd7d5e17-d089-4ff3-8b8e-bb2cb460ce5f => generated 1312 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 24 10:50:56.603715 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-2ce0f545-b824-44ea-8a6a-af4dcafdb0a5 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:50:56.605025 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-2ce0f545-b824-44ea-8a6a-af4dcafdb0a5 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] [instance: 1e267da4-1e48-4136-babc-656ccd50aae2] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:50:56.610834 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-2ce0f545-b824-44ea-8a6a-af4dcafdb0a5 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:50:56.611271 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-2ce0f545-b824-44ea-8a6a-af4dcafdb0a5 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:50:56.612115 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-2ce0f545-b824-44ea-8a6a-af4dcafdb0a5 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:50:56.612468 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-2ce0f545-b824-44ea-8a6a-af4dcafdb0a5 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:50:56.615612 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-d6a06675-aa0f-46ef-8326-e93454820e8e tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:50:56.616142 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-d6a06675-aa0f-46ef-8326-e93454820e8e tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] [instance: d2c0f276-f763-4337-a5dd-0c328c8c2e73] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:50:56.622620 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-d6a06675-aa0f-46ef-8326-e93454820e8e tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:50:56.623066 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-d6a06675-aa0f-46ef-8326-e93454820e8e tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:50:56.623847 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-d6a06675-aa0f-46ef-8326-e93454820e8e tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:50:56.624279 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-d6a06675-aa0f-46ef-8326-e93454820e8e tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:50:56.647062 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.objects.instance [None req-d6a06675-aa0f-46ef-8326-e93454820e8e tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lazy-loading 'flavor' on Instance uuid d2c0f276-f763-4337-a5dd-0c328c8c2e73 {{(pid=123432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 24 10:50:56.744744 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-2ce0f545-b824-44ea-8a6a-af4dcafdb0a5 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37516225f9244c969ed168f6a024482a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0115a5cc8b4b1e8bffb84e0f3e0b08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:50:56.752721 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-2ce0f545-b824-44ea-8a6a-af4dcafdb0a5 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] 10.222.0.30 "GET /compute/v2.1/servers/1e267da4-1e48-4136-babc-656ccd50aae2" status: 200 len: 1549 microversion: 2.1 time: 0.153258 Dec 24 10:50:56.753331 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 470/946] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:50:56 2021] GET /compute/v2.1/servers/1e267da4-1e48-4136-babc-656ccd50aae2 => generated 1549 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:50:56.768675 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-7131f878-3375-4edc-9638-041786294546 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:50:56.769186 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-7131f878-3375-4edc-9638-041786294546 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] [instance: 1e267da4-1e48-4136-babc-656ccd50aae2] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:50:56.774944 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-7131f878-3375-4edc-9638-041786294546 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:50:56.775669 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-7131f878-3375-4edc-9638-041786294546 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:50:56.776694 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-7131f878-3375-4edc-9638-041786294546 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:50:56.777168 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-7131f878-3375-4edc-9638-041786294546 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:50:56.860534 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-7131f878-3375-4edc-9638-041786294546 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] 10.222.0.30 "GET /compute/v2.1/servers/1e267da4-1e48-4136-babc-656ccd50aae2/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.095477 Dec 24 10:50:56.861182 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 471/947] 10.222.0.30 () {58 vars in 1274 bytes} [Fri Dec 24 10:50:56 2021] GET /compute/v2.1/servers/1e267da4-1e48-4136-babc-656ccd50aae2/os-interface => generated 284 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 24 10:50:57.253346 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-d6a06675-aa0f-46ef-8326-e93454820e8e tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] 10.222.0.30 "POST /compute/v2.1/servers/d2c0f276-f763-4337-a5dd-0c328c8c2e73/action" status: 202 len: 0 microversion: 2.20 time: 0.641151 Dec 24 10:50:57.257212 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 477/948] 10.222.0.30 () {62 vars in 1318 bytes} [Fri Dec 24 10:50:56 2021] POST /compute/v2.1/servers/d2c0f276-f763-4337-a5dd-0c328c8c2e73/action => generated 0 bytes in 646 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Dec 24 10:50:57.262763 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-4a6ec430-e4cb-41d8-8c87-773efafb9127 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:50:57.263357 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-4a6ec430-e4cb-41d8-8c87-773efafb9127 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] [instance: d2c0f276-f763-4337-a5dd-0c328c8c2e73] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:50:57.274987 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-4a6ec430-e4cb-41d8-8c87-773efafb9127 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:50:57.275435 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-4a6ec430-e4cb-41d8-8c87-773efafb9127 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:50:57.276771 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-4a6ec430-e4cb-41d8-8c87-773efafb9127 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:50:57.277256 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-4a6ec430-e4cb-41d8-8c87-773efafb9127 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:50:57.411337 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-4a6ec430-e4cb-41d8-8c87-773efafb9127 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:50:57.419237 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-4a6ec430-e4cb-41d8-8c87-773efafb9127 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:50:57.420743 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-4a6ec430-e4cb-41d8-8c87-773efafb9127 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:50:57.421931 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-4a6ec430-e4cb-41d8-8c87-773efafb9127 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] 10.222.0.30 "GET /compute/v2.1/servers/d2c0f276-f763-4337-a5dd-0c328c8c2e73" status: 200 len: 1723 microversion: 2.20 time: 0.163406 Dec 24 10:50:57.422494 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 472/949] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Dec 24 10:50:57 2021] GET /compute/v2.1/servers/d2c0f276-f763-4337-a5dd-0c328c8c2e73 => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 10:50:57.609066 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-55bb8905-dfe5-4424-8bef-6cfcee54cadf tempest-VolumesActionsTest-1489615802 tempest-VolumesActionsTest-1489615802-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:50:57.609764 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-55bb8905-dfe5-4424-8bef-6cfcee54cadf tempest-VolumesActionsTest-1489615802 tempest-VolumesActionsTest-1489615802-project] [instance: cd7d5e17-d089-4ff3-8b8e-bb2cb460ce5f] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:50:57.615979 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-55bb8905-dfe5-4424-8bef-6cfcee54cadf tempest-VolumesActionsTest-1489615802 tempest-VolumesActionsTest-1489615802-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:50:57.616427 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-55bb8905-dfe5-4424-8bef-6cfcee54cadf tempest-VolumesActionsTest-1489615802 tempest-VolumesActionsTest-1489615802-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:50:57.617240 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-55bb8905-dfe5-4424-8bef-6cfcee54cadf tempest-VolumesActionsTest-1489615802 tempest-VolumesActionsTest-1489615802-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:50:57.617697 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-55bb8905-dfe5-4424-8bef-6cfcee54cadf tempest-VolumesActionsTest-1489615802 tempest-VolumesActionsTest-1489615802-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:50:57.808074 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-55bb8905-dfe5-4424-8bef-6cfcee54cadf tempest-VolumesActionsTest-1489615802 tempest-VolumesActionsTest-1489615802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b484152f59664123bf8c9d4c56bfebb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8a5fd5e33e4d059b152730ca60d5c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:50:57.815439 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-55bb8905-dfe5-4424-8bef-6cfcee54cadf tempest-VolumesActionsTest-1489615802 tempest-VolumesActionsTest-1489615802-project] 10.222.0.30 "GET /compute/v2.1/servers/cd7d5e17-d089-4ff3-8b8e-bb2cb460ce5f" status: 200 len: 1312 microversion: 2.1 time: 0.210932 Dec 24 10:50:57.820409 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 478/950] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:50:57 2021] GET /compute/v2.1/servers/cd7d5e17-d089-4ff3-8b8e-bb2cb460ce5f => generated 1312 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:50:57.947591 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-b654b61f-d43c-4da1-8619-6ca3c7ffccae tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:50:57.948587 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-b654b61f-d43c-4da1-8619-6ca3c7ffccae tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] [instance: 1e267da4-1e48-4136-babc-656ccd50aae2] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:50:57.950688 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [req-d473598c-97c7-4826-aff9-58cb1f089fd1 req-fe469374-7b96-40d3-812b-a8da6bb9086d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1e267da4-1e48-4136-babc-656ccd50aae2", "tag": "77f6b8b9-344d-496a-a27c-ff476412f5e6"}]} {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:50:57.952285 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 10:50:57.952285 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: warnings.warn(msg) Dec 24 10:50:57.955039 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-b654b61f-d43c-4da1-8619-6ca3c7ffccae tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:50:57.955484 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-b654b61f-d43c-4da1-8619-6ca3c7ffccae tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:50:57.956264 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-b654b61f-d43c-4da1-8619-6ca3c7ffccae tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:50:57.956693 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-b654b61f-d43c-4da1-8619-6ca3c7ffccae tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:50:57.961170 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [req-d473598c-97c7-4826-aff9-58cb1f089fd1 req-fe469374-7b96-40d3-812b-a8da6bb9086d service nova] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:50:57.961694 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [req-d473598c-97c7-4826-aff9-58cb1f089fd1 req-fe469374-7b96-40d3-812b-a8da6bb9086d service nova] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:50:57.973392 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.compute.server_external_events [req-d473598c-97c7-4826-aff9-58cb1f089fd1 req-fe469374-7b96-40d3-812b-a8da6bb9086d service nova] Creating event network-changed:77f6b8b9-344d-496a-a27c-ff476412f5e6 for instance 1e267da4-1e48-4136-babc-656ccd50aae2 on hv-cinder-81644 Dec 24 10:50:57.978426 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [req-d473598c-97c7-4826-aff9-58cb1f089fd1 req-fe469374-7b96-40d3-812b-a8da6bb9086d service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031739 Dec 24 10:50:57.979947 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 479/951] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Dec 24 10:50:57 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 24 10:50:58.025602 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-b654b61f-d43c-4da1-8619-6ca3c7ffccae tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] 10.222.0.30 "POST /compute/v2.1/servers/1e267da4-1e48-4136-babc-656ccd50aae2/action" status: 200 len: 14 microversion: 2.1 time: 0.081088 Dec 24 10:50:58.026569 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 473/952] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Dec 24 10:50:57 2021] POST /compute/v2.1/servers/1e267da4-1e48-4136-babc-656ccd50aae2/action => generated 14 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 24 10:50:58.440294 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-b1b3e6bf-b952-490c-8012-d3f8b67b2e7a tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:50:58.441059 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-b1b3e6bf-b952-490c-8012-d3f8b67b2e7a tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] [instance: d2c0f276-f763-4337-a5dd-0c328c8c2e73] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:50:58.447728 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-b1b3e6bf-b952-490c-8012-d3f8b67b2e7a tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:50:58.448686 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-b1b3e6bf-b952-490c-8012-d3f8b67b2e7a tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:50:58.449539 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-b1b3e6bf-b952-490c-8012-d3f8b67b2e7a tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:50:58.449947 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-b1b3e6bf-b952-490c-8012-d3f8b67b2e7a tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:50:58.617276 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-b1b3e6bf-b952-490c-8012-d3f8b67b2e7a tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:50:58.625113 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-b1b3e6bf-b952-490c-8012-d3f8b67b2e7a tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:50:58.626611 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-b1b3e6bf-b952-490c-8012-d3f8b67b2e7a tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:50:58.627768 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-b1b3e6bf-b952-490c-8012-d3f8b67b2e7a tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] 10.222.0.30 "GET /compute/v2.1/servers/d2c0f276-f763-4337-a5dd-0c328c8c2e73" status: 200 len: 1723 microversion: 2.20 time: 0.191690 Dec 24 10:50:58.628326 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 480/953] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Dec 24 10:50:58 2021] GET /compute/v2.1/servers/d2c0f276-f763-4337-a5dd-0c328c8c2e73 => generated 1723 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 10:50:58.836479 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-6780d40b-767f-4b1b-b721-9bab408ca388 tempest-VolumesActionsTest-1489615802 tempest-VolumesActionsTest-1489615802-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:50:58.836712 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-6780d40b-767f-4b1b-b721-9bab408ca388 tempest-VolumesActionsTest-1489615802 tempest-VolumesActionsTest-1489615802-project] [instance: cd7d5e17-d089-4ff3-8b8e-bb2cb460ce5f] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:50:58.844230 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-6780d40b-767f-4b1b-b721-9bab408ca388 tempest-VolumesActionsTest-1489615802 tempest-VolumesActionsTest-1489615802-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:50:58.844770 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-6780d40b-767f-4b1b-b721-9bab408ca388 tempest-VolumesActionsTest-1489615802 tempest-VolumesActionsTest-1489615802-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:50:58.845658 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-6780d40b-767f-4b1b-b721-9bab408ca388 tempest-VolumesActionsTest-1489615802 tempest-VolumesActionsTest-1489615802-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:50:58.846153 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-6780d40b-767f-4b1b-b721-9bab408ca388 tempest-VolumesActionsTest-1489615802 tempest-VolumesActionsTest-1489615802-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:50:58.982545 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-6780d40b-767f-4b1b-b721-9bab408ca388 tempest-VolumesActionsTest-1489615802 tempest-VolumesActionsTest-1489615802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b484152f59664123bf8c9d4c56bfebb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8a5fd5e33e4d059b152730ca60d5c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:50:59.005549 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-6780d40b-767f-4b1b-b721-9bab408ca388 tempest-VolumesActionsTest-1489615802 tempest-VolumesActionsTest-1489615802-project] 10.222.0.30 "GET /compute/v2.1/servers/cd7d5e17-d089-4ff3-8b8e-bb2cb460ce5f" status: 200 len: 1312 microversion: 2.1 time: 0.173410 Dec 24 10:50:59.005966 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 474/954] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:50:58 2021] GET /compute/v2.1/servers/cd7d5e17-d089-4ff3-8b8e-bb2cb460ce5f => generated 1312 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 24 10:50:59.036277 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-48a928f5-d2d0-46c8-b813-1e15ec610972 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:50:59.037281 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-48a928f5-d2d0-46c8-b813-1e15ec610972 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] [instance: 1e267da4-1e48-4136-babc-656ccd50aae2] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:50:59.043594 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-48a928f5-d2d0-46c8-b813-1e15ec610972 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:50:59.044054 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-48a928f5-d2d0-46c8-b813-1e15ec610972 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:50:59.044872 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-48a928f5-d2d0-46c8-b813-1e15ec610972 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:50:59.045316 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-48a928f5-d2d0-46c8-b813-1e15ec610972 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:50:59.105081 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-48a928f5-d2d0-46c8-b813-1e15ec610972 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] 10.222.0.30 "POST /compute/v2.1/servers/1e267da4-1e48-4136-babc-656ccd50aae2/action" status: 200 len: 14 microversion: 2.1 time: 0.072243 Dec 24 10:50:59.105731 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 481/955] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Dec 24 10:50:59 2021] POST /compute/v2.1/servers/1e267da4-1e48-4136-babc-656ccd50aae2/action => generated 14 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 24 10:50:59.646339 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-9c13ae6a-c06d-4845-8647-02113c280124 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:50:59.646950 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-9c13ae6a-c06d-4845-8647-02113c280124 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] [instance: d2c0f276-f763-4337-a5dd-0c328c8c2e73] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:50:59.655008 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-9c13ae6a-c06d-4845-8647-02113c280124 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:50:59.655458 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-9c13ae6a-c06d-4845-8647-02113c280124 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:50:59.656236 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-9c13ae6a-c06d-4845-8647-02113c280124 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:50:59.656665 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-9c13ae6a-c06d-4845-8647-02113c280124 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:50:59.793513 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-9c13ae6a-c06d-4845-8647-02113c280124 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:50:59.801164 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-9c13ae6a-c06d-4845-8647-02113c280124 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:50:59.802678 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-9c13ae6a-c06d-4845-8647-02113c280124 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:50:59.803821 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-9c13ae6a-c06d-4845-8647-02113c280124 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] 10.222.0.30 "GET /compute/v2.1/servers/d2c0f276-f763-4337-a5dd-0c328c8c2e73" status: 200 len: 1723 microversion: 2.20 time: 0.161552 Dec 24 10:50:59.804378 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 475/956] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Dec 24 10:50:59 2021] GET /compute/v2.1/servers/d2c0f276-f763-4337-a5dd-0c328c8c2e73 => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 10:51:00.028643 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-7089e8ea-0034-401e-be6b-2516da9c5e61 tempest-VolumesActionsTest-1489615802 tempest-VolumesActionsTest-1489615802-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:51:00.029148 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-7089e8ea-0034-401e-be6b-2516da9c5e61 tempest-VolumesActionsTest-1489615802 tempest-VolumesActionsTest-1489615802-project] [instance: cd7d5e17-d089-4ff3-8b8e-bb2cb460ce5f] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:51:00.036226 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-7089e8ea-0034-401e-be6b-2516da9c5e61 tempest-VolumesActionsTest-1489615802 tempest-VolumesActionsTest-1489615802-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:51:00.036671 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-7089e8ea-0034-401e-be6b-2516da9c5e61 tempest-VolumesActionsTest-1489615802 tempest-VolumesActionsTest-1489615802-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:51:00.037503 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-7089e8ea-0034-401e-be6b-2516da9c5e61 tempest-VolumesActionsTest-1489615802 tempest-VolumesActionsTest-1489615802-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:51:00.037940 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-7089e8ea-0034-401e-be6b-2516da9c5e61 tempest-VolumesActionsTest-1489615802 tempest-VolumesActionsTest-1489615802-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:51:00.115935 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-aecf6402-214a-49ae-a653-0ed92149aa53 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:51:00.117608 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-aecf6402-214a-49ae-a653-0ed92149aa53 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] [instance: 1e267da4-1e48-4136-babc-656ccd50aae2] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:51:00.149396 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-aecf6402-214a-49ae-a653-0ed92149aa53 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:51:00.149396 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-aecf6402-214a-49ae-a653-0ed92149aa53 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:51:00.153710 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-aecf6402-214a-49ae-a653-0ed92149aa53 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:51:00.154214 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-aecf6402-214a-49ae-a653-0ed92149aa53 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:51:00.187004 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-7089e8ea-0034-401e-be6b-2516da9c5e61 tempest-VolumesActionsTest-1489615802 tempest-VolumesActionsTest-1489615802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b484152f59664123bf8c9d4c56bfebb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8a5fd5e33e4d059b152730ca60d5c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:51:00.194633 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-7089e8ea-0034-401e-be6b-2516da9c5e61 tempest-VolumesActionsTest-1489615802 tempest-VolumesActionsTest-1489615802-project] 10.222.0.30 "GET /compute/v2.1/servers/cd7d5e17-d089-4ff3-8b8e-bb2cb460ce5f" status: 200 len: 1312 microversion: 2.1 time: 0.175245 Dec 24 10:51:00.195203 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 482/957] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:51:00 2021] GET /compute/v2.1/servers/cd7d5e17-d089-4ff3-8b8e-bb2cb460ce5f => generated 1312 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:51:00.199990 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [req-d9685af5-e8bf-401b-9dc2-cf27f419bbdb req-052ae40b-d18f-4034-a119-1df523045e0a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd7d5e17-d089-4ff3-8b8e-bb2cb460ce5f", "name": "network-vif-plugged", "status": "completed", "tag": "f7f94f7c-037f-4b6a-8285-ce790ac9221c"}]} {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:51:00.201487 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 10:51:00.201487 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: warnings.warn(msg) Dec 24 10:51:00.208017 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [req-d9685af5-e8bf-401b-9dc2-cf27f419bbdb req-052ae40b-d18f-4034-a119-1df523045e0a service nova] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:51:00.212057 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [req-d9685af5-e8bf-401b-9dc2-cf27f419bbdb req-052ae40b-d18f-4034-a119-1df523045e0a service nova] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:51:00.221253 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.compute.server_external_events [req-d9685af5-e8bf-401b-9dc2-cf27f419bbdb req-052ae40b-d18f-4034-a119-1df523045e0a service nova] Creating event network-vif-plugged:f7f94f7c-037f-4b6a-8285-ce790ac9221c for instance cd7d5e17-d089-4ff3-8b8e-bb2cb460ce5f on hv-cinder-81644 Dec 24 10:51:00.226292 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-aecf6402-214a-49ae-a653-0ed92149aa53 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] 10.222.0.30 "POST /compute/v2.1/servers/1e267da4-1e48-4136-babc-656ccd50aae2/action" status: 200 len: 14 microversion: 2.1 time: 0.113948 Dec 24 10:51:00.226690 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [req-d9685af5-e8bf-401b-9dc2-cf27f419bbdb req-052ae40b-d18f-4034-a119-1df523045e0a service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030398 Dec 24 10:51:00.226996 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 476/958] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Dec 24 10:51:00 2021] POST /compute/v2.1/servers/1e267da4-1e48-4136-babc-656ccd50aae2/action => generated 14 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Dec 24 10:51:00.227495 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 483/959] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Dec 24 10:51:00 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 10:51:00.822120 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-5d513a19-8f08-47ce-9811-9378ffdd4edc tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:51:00.823418 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-5d513a19-8f08-47ce-9811-9378ffdd4edc tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] [instance: d2c0f276-f763-4337-a5dd-0c328c8c2e73] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:51:00.829604 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-5d513a19-8f08-47ce-9811-9378ffdd4edc tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:51:00.830186 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-5d513a19-8f08-47ce-9811-9378ffdd4edc tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:51:00.830976 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-5d513a19-8f08-47ce-9811-9378ffdd4edc tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:51:00.831482 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-5d513a19-8f08-47ce-9811-9378ffdd4edc tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:51:00.969299 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-5d513a19-8f08-47ce-9811-9378ffdd4edc tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:51:00.977521 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-5d513a19-8f08-47ce-9811-9378ffdd4edc tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:51:00.979501 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-5d513a19-8f08-47ce-9811-9378ffdd4edc tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:51:00.980699 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-5d513a19-8f08-47ce-9811-9378ffdd4edc tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] 10.222.0.30 "GET /compute/v2.1/servers/d2c0f276-f763-4337-a5dd-0c328c8c2e73" status: 200 len: 1723 microversion: 2.20 time: 0.162771 Dec 24 10:51:00.981293 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 477/960] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Dec 24 10:51:00 2021] GET /compute/v2.1/servers/d2c0f276-f763-4337-a5dd-0c328c8c2e73 => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 10:51:01.212231 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-a5ed0115-bdd1-452e-a25c-97217010b74f tempest-VolumesActionsTest-1489615802 tempest-VolumesActionsTest-1489615802-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:51:01.212963 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-a5ed0115-bdd1-452e-a25c-97217010b74f tempest-VolumesActionsTest-1489615802 tempest-VolumesActionsTest-1489615802-project] [instance: cd7d5e17-d089-4ff3-8b8e-bb2cb460ce5f] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:51:01.219984 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-a5ed0115-bdd1-452e-a25c-97217010b74f tempest-VolumesActionsTest-1489615802 tempest-VolumesActionsTest-1489615802-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:51:01.220425 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-a5ed0115-bdd1-452e-a25c-97217010b74f tempest-VolumesActionsTest-1489615802 tempest-VolumesActionsTest-1489615802-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:51:01.221234 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-a5ed0115-bdd1-452e-a25c-97217010b74f tempest-VolumesActionsTest-1489615802 tempest-VolumesActionsTest-1489615802-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:51:01.221665 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-a5ed0115-bdd1-452e-a25c-97217010b74f tempest-VolumesActionsTest-1489615802 tempest-VolumesActionsTest-1489615802-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:51:01.237469 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-ef122db1-d099-4e94-929f-fc25d2b7bd6c tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:51:01.238460 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-ef122db1-d099-4e94-929f-fc25d2b7bd6c tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] [instance: 1e267da4-1e48-4136-babc-656ccd50aae2] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:51:01.245150 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-ef122db1-d099-4e94-929f-fc25d2b7bd6c tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:51:01.245593 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-ef122db1-d099-4e94-929f-fc25d2b7bd6c tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:51:01.246375 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-ef122db1-d099-4e94-929f-fc25d2b7bd6c tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:51:01.246809 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-ef122db1-d099-4e94-929f-fc25d2b7bd6c tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:51:01.324361 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-ef122db1-d099-4e94-929f-fc25d2b7bd6c tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] 10.222.0.30 "POST /compute/v2.1/servers/1e267da4-1e48-4136-babc-656ccd50aae2/action" status: 200 len: 14 microversion: 2.1 time: 0.090312 Dec 24 10:51:01.327412 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 478/961] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Dec 24 10:51:01 2021] POST /compute/v2.1/servers/1e267da4-1e48-4136-babc-656ccd50aae2/action => generated 14 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Dec 24 10:51:01.355732 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-a5ed0115-bdd1-452e-a25c-97217010b74f tempest-VolumesActionsTest-1489615802 tempest-VolumesActionsTest-1489615802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b484152f59664123bf8c9d4c56bfebb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8a5fd5e33e4d059b152730ca60d5c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:51:01.363417 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-a5ed0115-bdd1-452e-a25c-97217010b74f tempest-VolumesActionsTest-1489615802 tempest-VolumesActionsTest-1489615802-project] 10.222.0.30 "GET /compute/v2.1/servers/cd7d5e17-d089-4ff3-8b8e-bb2cb460ce5f" status: 200 len: 1312 microversion: 2.1 time: 0.155160 Dec 24 10:51:01.363992 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 484/962] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:51:01 2021] GET /compute/v2.1/servers/cd7d5e17-d089-4ff3-8b8e-bb2cb460ce5f => generated 1312 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:51:02.000026 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-6aea08aa-64e3-47e3-9791-e08326f2219b tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:51:02.000809 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-6aea08aa-64e3-47e3-9791-e08326f2219b tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] [instance: d2c0f276-f763-4337-a5dd-0c328c8c2e73] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:51:02.007600 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-6aea08aa-64e3-47e3-9791-e08326f2219b tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:51:02.008041 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-6aea08aa-64e3-47e3-9791-e08326f2219b tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:51:02.008807 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-6aea08aa-64e3-47e3-9791-e08326f2219b tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:51:02.009255 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-6aea08aa-64e3-47e3-9791-e08326f2219b tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:51:02.159736 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-6aea08aa-64e3-47e3-9791-e08326f2219b tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:51:02.167590 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-6aea08aa-64e3-47e3-9791-e08326f2219b tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:51:02.169234 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-6aea08aa-64e3-47e3-9791-e08326f2219b tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:51:02.170370 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-6aea08aa-64e3-47e3-9791-e08326f2219b tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] 10.222.0.30 "GET /compute/v2.1/servers/d2c0f276-f763-4337-a5dd-0c328c8c2e73" status: 200 len: 1723 microversion: 2.20 time: 0.174703 Dec 24 10:51:02.170981 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 479/963] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Dec 24 10:51:01 2021] GET /compute/v2.1/servers/d2c0f276-f763-4337-a5dd-0c328c8c2e73 => generated 1723 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 10:51:02.335060 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-ac26a314-7099-4485-89c0-78e28030aad3 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:51:02.335963 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-ac26a314-7099-4485-89c0-78e28030aad3 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] [instance: 1e267da4-1e48-4136-babc-656ccd50aae2] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:51:02.342201 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-ac26a314-7099-4485-89c0-78e28030aad3 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:51:02.342652 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-ac26a314-7099-4485-89c0-78e28030aad3 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:51:02.343432 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-ac26a314-7099-4485-89c0-78e28030aad3 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:51:02.343902 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-ac26a314-7099-4485-89c0-78e28030aad3 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:51:02.380469 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-b150a079-2183-4ff7-8d12-da25e69d936a tempest-VolumesActionsTest-1489615802 tempest-VolumesActionsTest-1489615802-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:51:02.381101 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-b150a079-2183-4ff7-8d12-da25e69d936a tempest-VolumesActionsTest-1489615802 tempest-VolumesActionsTest-1489615802-project] [instance: cd7d5e17-d089-4ff3-8b8e-bb2cb460ce5f] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:51:02.387403 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-b150a079-2183-4ff7-8d12-da25e69d936a tempest-VolumesActionsTest-1489615802 tempest-VolumesActionsTest-1489615802-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:51:02.387846 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-b150a079-2183-4ff7-8d12-da25e69d936a tempest-VolumesActionsTest-1489615802 tempest-VolumesActionsTest-1489615802-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:51:02.388612 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-b150a079-2183-4ff7-8d12-da25e69d936a tempest-VolumesActionsTest-1489615802 tempest-VolumesActionsTest-1489615802-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:51:02.389067 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-b150a079-2183-4ff7-8d12-da25e69d936a tempest-VolumesActionsTest-1489615802 tempest-VolumesActionsTest-1489615802-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:51:02.429562 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-ac26a314-7099-4485-89c0-78e28030aad3 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] 10.222.0.30 "POST /compute/v2.1/servers/1e267da4-1e48-4136-babc-656ccd50aae2/action" status: 200 len: 14 microversion: 2.1 time: 0.097981 Dec 24 10:51:02.430375 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 485/964] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Dec 24 10:51:02 2021] POST /compute/v2.1/servers/1e267da4-1e48-4136-babc-656ccd50aae2/action => generated 14 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 24 10:51:02.514459 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-b150a079-2183-4ff7-8d12-da25e69d936a tempest-VolumesActionsTest-1489615802 tempest-VolumesActionsTest-1489615802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b484152f59664123bf8c9d4c56bfebb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8a5fd5e33e4d059b152730ca60d5c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:51:02.522049 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-b150a079-2183-4ff7-8d12-da25e69d936a tempest-VolumesActionsTest-1489615802 tempest-VolumesActionsTest-1489615802-project] 10.222.0.30 "GET /compute/v2.1/servers/cd7d5e17-d089-4ff3-8b8e-bb2cb460ce5f" status: 200 len: 1495 microversion: 2.1 time: 0.145226 Dec 24 10:51:02.522650 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 480/965] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:51:02 2021] GET /compute/v2.1/servers/cd7d5e17-d089-4ff3-8b8e-bb2cb460ce5f => generated 1495 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 24 10:51:03.189394 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-6135685c-45d2-4af2-97fc-3bcf26b70ffb tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:51:03.190111 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-6135685c-45d2-4af2-97fc-3bcf26b70ffb tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] [instance: d2c0f276-f763-4337-a5dd-0c328c8c2e73] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:51:03.197866 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-6135685c-45d2-4af2-97fc-3bcf26b70ffb tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:51:03.198397 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-6135685c-45d2-4af2-97fc-3bcf26b70ffb tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:51:03.199284 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-6135685c-45d2-4af2-97fc-3bcf26b70ffb tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:51:03.199786 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-6135685c-45d2-4af2-97fc-3bcf26b70ffb tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:51:03.330501 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-6135685c-45d2-4af2-97fc-3bcf26b70ffb tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:51:03.339135 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-6135685c-45d2-4af2-97fc-3bcf26b70ffb tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:51:03.340697 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-6135685c-45d2-4af2-97fc-3bcf26b70ffb tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:51:03.341983 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-6135685c-45d2-4af2-97fc-3bcf26b70ffb tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] 10.222.0.30 "GET /compute/v2.1/servers/d2c0f276-f763-4337-a5dd-0c328c8c2e73" status: 200 len: 1723 microversion: 2.20 time: 0.157010 Dec 24 10:51:03.347327 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 486/966] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Dec 24 10:51:03 2021] GET /compute/v2.1/servers/d2c0f276-f763-4337-a5dd-0c328c8c2e73 => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 10:51:03.440675 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-88bc17ed-cc16-4945-82c5-dc7e808695dc tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:51:03.441690 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-88bc17ed-cc16-4945-82c5-dc7e808695dc tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] [instance: 1e267da4-1e48-4136-babc-656ccd50aae2] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:51:03.448489 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-88bc17ed-cc16-4945-82c5-dc7e808695dc tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:51:03.448966 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-88bc17ed-cc16-4945-82c5-dc7e808695dc tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:51:03.449735 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-88bc17ed-cc16-4945-82c5-dc7e808695dc tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:51:03.450162 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-88bc17ed-cc16-4945-82c5-dc7e808695dc tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:51:03.531195 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-88bc17ed-cc16-4945-82c5-dc7e808695dc tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] 10.222.0.30 "POST /compute/v2.1/servers/1e267da4-1e48-4136-babc-656ccd50aae2/action" status: 200 len: 14 microversion: 2.1 time: 0.093985 Dec 24 10:51:03.534236 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 481/967] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Dec 24 10:51:03 2021] POST /compute/v2.1/servers/1e267da4-1e48-4136-babc-656ccd50aae2/action => generated 14 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 24 10:51:03.570807 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-33501a49-1769-4c03-a124-864b5976ca90 tempest-VolumesActionsTest-1489615802 tempest-VolumesActionsTest-1489615802-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:51:03.571306 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-33501a49-1769-4c03-a124-864b5976ca90 tempest-VolumesActionsTest-1489615802 tempest-VolumesActionsTest-1489615802-project] [instance: cd7d5e17-d089-4ff3-8b8e-bb2cb460ce5f] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:51:03.578146 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-33501a49-1769-4c03-a124-864b5976ca90 tempest-VolumesActionsTest-1489615802 tempest-VolumesActionsTest-1489615802-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:51:03.578592 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-33501a49-1769-4c03-a124-864b5976ca90 tempest-VolumesActionsTest-1489615802 tempest-VolumesActionsTest-1489615802-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:51:03.579372 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-33501a49-1769-4c03-a124-864b5976ca90 tempest-VolumesActionsTest-1489615802 tempest-VolumesActionsTest-1489615802-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:51:03.579806 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-33501a49-1769-4c03-a124-864b5976ca90 tempest-VolumesActionsTest-1489615802 tempest-VolumesActionsTest-1489615802-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:51:03.603580 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-33501a49-1769-4c03-a124-864b5976ca90 tempest-VolumesActionsTest-1489615802 tempest-VolumesActionsTest-1489615802-project] [instance: cd7d5e17-d089-4ff3-8b8e-bb2cb460ce5f] Going to try to terminate instance {{(pid=123432) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 24 10:51:04.026777 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-33501a49-1769-4c03-a124-864b5976ca90 tempest-VolumesActionsTest-1489615802 tempest-VolumesActionsTest-1489615802-project] 10.222.0.30 "DELETE /compute/v2.1/servers/cd7d5e17-d089-4ff3-8b8e-bb2cb460ce5f" status: 204 len: 0 microversion: 2.1 time: 0.459202 Dec 24 10:51:04.027477 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 487/968] 10.222.0.30 () {58 vars in 1238 bytes} [Fri Dec 24 10:51:03 2021] DELETE /compute/v2.1/servers/cd7d5e17-d089-4ff3-8b8e-bb2cb460ce5f => generated 0 bytes in 461 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 24 10:51:04.036021 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-b8b800d6-ff5d-4805-b7e5-ea577b164a1b tempest-VolumesActionsTest-1489615802 tempest-VolumesActionsTest-1489615802-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:51:04.036721 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-b8b800d6-ff5d-4805-b7e5-ea577b164a1b tempest-VolumesActionsTest-1489615802 tempest-VolumesActionsTest-1489615802-project] [instance: cd7d5e17-d089-4ff3-8b8e-bb2cb460ce5f] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:51:04.044044 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-b8b800d6-ff5d-4805-b7e5-ea577b164a1b tempest-VolumesActionsTest-1489615802 tempest-VolumesActionsTest-1489615802-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:51:04.044490 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-b8b800d6-ff5d-4805-b7e5-ea577b164a1b tempest-VolumesActionsTest-1489615802 tempest-VolumesActionsTest-1489615802-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:51:04.045369 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-b8b800d6-ff5d-4805-b7e5-ea577b164a1b tempest-VolumesActionsTest-1489615802 tempest-VolumesActionsTest-1489615802-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:51:04.045949 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-b8b800d6-ff5d-4805-b7e5-ea577b164a1b tempest-VolumesActionsTest-1489615802 tempest-VolumesActionsTest-1489615802-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:51:04.193644 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-b8b800d6-ff5d-4805-b7e5-ea577b164a1b tempest-VolumesActionsTest-1489615802 tempest-VolumesActionsTest-1489615802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b484152f59664123bf8c9d4c56bfebb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8a5fd5e33e4d059b152730ca60d5c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:51:04.200985 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-b8b800d6-ff5d-4805-b7e5-ea577b164a1b tempest-VolumesActionsTest-1489615802 tempest-VolumesActionsTest-1489615802-project] 10.222.0.30 "GET /compute/v2.1/servers/cd7d5e17-d089-4ff3-8b8e-bb2cb460ce5f" status: 200 len: 1501 microversion: 2.1 time: 0.168902 Dec 24 10:51:04.201559 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 482/969] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:51:04 2021] GET /compute/v2.1/servers/cd7d5e17-d089-4ff3-8b8e-bb2cb460ce5f => generated 1501 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:51:04.363841 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-dd03c961-11ce-4dd4-872c-8f4386289868 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:51:04.364550 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-dd03c961-11ce-4dd4-872c-8f4386289868 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] [instance: d2c0f276-f763-4337-a5dd-0c328c8c2e73] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:51:04.371308 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-dd03c961-11ce-4dd4-872c-8f4386289868 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:51:04.371755 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-dd03c961-11ce-4dd4-872c-8f4386289868 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:51:04.372530 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-dd03c961-11ce-4dd4-872c-8f4386289868 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:51:04.372994 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-dd03c961-11ce-4dd4-872c-8f4386289868 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:51:04.500312 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-dd03c961-11ce-4dd4-872c-8f4386289868 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:51:04.508004 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-dd03c961-11ce-4dd4-872c-8f4386289868 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:51:04.509532 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-dd03c961-11ce-4dd4-872c-8f4386289868 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:51:04.510678 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-dd03c961-11ce-4dd4-872c-8f4386289868 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] 10.222.0.30 "GET /compute/v2.1/servers/d2c0f276-f763-4337-a5dd-0c328c8c2e73" status: 200 len: 1723 microversion: 2.20 time: 0.150910 Dec 24 10:51:04.511237 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 488/970] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Dec 24 10:51:04 2021] GET /compute/v2.1/servers/d2c0f276-f763-4337-a5dd-0c328c8c2e73 => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 10:51:04.542189 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-328bbe61-efb0-44ed-b201-a53af3594614 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:51:04.543130 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-328bbe61-efb0-44ed-b201-a53af3594614 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] [instance: 1e267da4-1e48-4136-babc-656ccd50aae2] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:51:04.549523 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-328bbe61-efb0-44ed-b201-a53af3594614 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:51:04.549971 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-328bbe61-efb0-44ed-b201-a53af3594614 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:51:04.550755 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-328bbe61-efb0-44ed-b201-a53af3594614 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:51:04.551795 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-328bbe61-efb0-44ed-b201-a53af3594614 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:51:04.620520 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-328bbe61-efb0-44ed-b201-a53af3594614 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] 10.222.0.30 "POST /compute/v2.1/servers/1e267da4-1e48-4136-babc-656ccd50aae2/action" status: 200 len: 14 microversion: 2.1 time: 0.082347 Dec 24 10:51:04.621178 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 483/971] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Dec 24 10:51:04 2021] POST /compute/v2.1/servers/1e267da4-1e48-4136-babc-656ccd50aae2/action => generated 14 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 24 10:51:05.218816 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-070e71a4-08bd-4bae-a2f2-112de3550063 tempest-VolumesActionsTest-1489615802 tempest-VolumesActionsTest-1489615802-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:51:05.219412 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-070e71a4-08bd-4bae-a2f2-112de3550063 tempest-VolumesActionsTest-1489615802 tempest-VolumesActionsTest-1489615802-project] [instance: cd7d5e17-d089-4ff3-8b8e-bb2cb460ce5f] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:51:05.225495 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-070e71a4-08bd-4bae-a2f2-112de3550063 tempest-VolumesActionsTest-1489615802 tempest-VolumesActionsTest-1489615802-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:51:05.230227 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-070e71a4-08bd-4bae-a2f2-112de3550063 tempest-VolumesActionsTest-1489615802 tempest-VolumesActionsTest-1489615802-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:51:05.230227 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-070e71a4-08bd-4bae-a2f2-112de3550063 tempest-VolumesActionsTest-1489615802 tempest-VolumesActionsTest-1489615802-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:51:05.230227 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-070e71a4-08bd-4bae-a2f2-112de3550063 tempest-VolumesActionsTest-1489615802 tempest-VolumesActionsTest-1489615802-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:51:05.359067 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-070e71a4-08bd-4bae-a2f2-112de3550063 tempest-VolumesActionsTest-1489615802 tempest-VolumesActionsTest-1489615802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b484152f59664123bf8c9d4c56bfebb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8a5fd5e33e4d059b152730ca60d5c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:51:05.366264 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-070e71a4-08bd-4bae-a2f2-112de3550063 tempest-VolumesActionsTest-1489615802 tempest-VolumesActionsTest-1489615802-project] 10.222.0.30 "GET /compute/v2.1/servers/cd7d5e17-d089-4ff3-8b8e-bb2cb460ce5f" status: 200 len: 1501 microversion: 2.1 time: 0.151119 Dec 24 10:51:05.366953 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 489/972] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:51:05 2021] GET /compute/v2.1/servers/cd7d5e17-d089-4ff3-8b8e-bb2cb460ce5f => generated 1501 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:51:05.529838 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-47846dda-20d7-4cd1-8556-b3b1cc568d64 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:51:05.530463 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-47846dda-20d7-4cd1-8556-b3b1cc568d64 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] [instance: d2c0f276-f763-4337-a5dd-0c328c8c2e73] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:51:05.538163 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-47846dda-20d7-4cd1-8556-b3b1cc568d64 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:51:05.538620 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-47846dda-20d7-4cd1-8556-b3b1cc568d64 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:51:05.539397 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-47846dda-20d7-4cd1-8556-b3b1cc568d64 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:51:05.539825 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-47846dda-20d7-4cd1-8556-b3b1cc568d64 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:51:05.630951 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-6c5c2b7a-70c3-4538-8494-eac8d9a8816b tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:51:05.631849 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-6c5c2b7a-70c3-4538-8494-eac8d9a8816b tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] [instance: 1e267da4-1e48-4136-babc-656ccd50aae2] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:51:05.638865 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-6c5c2b7a-70c3-4538-8494-eac8d9a8816b tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:51:05.639390 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-6c5c2b7a-70c3-4538-8494-eac8d9a8816b tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:51:05.640250 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-6c5c2b7a-70c3-4538-8494-eac8d9a8816b tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:51:05.640753 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-6c5c2b7a-70c3-4538-8494-eac8d9a8816b tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:51:05.670380 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-47846dda-20d7-4cd1-8556-b3b1cc568d64 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:51:05.678630 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-47846dda-20d7-4cd1-8556-b3b1cc568d64 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:51:05.680132 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-47846dda-20d7-4cd1-8556-b3b1cc568d64 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:51:05.681342 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-47846dda-20d7-4cd1-8556-b3b1cc568d64 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] 10.222.0.30 "GET /compute/v2.1/servers/d2c0f276-f763-4337-a5dd-0c328c8c2e73" status: 200 len: 1723 microversion: 2.20 time: 0.155738 Dec 24 10:51:05.681909 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 484/973] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Dec 24 10:51:05 2021] GET /compute/v2.1/servers/d2c0f276-f763-4337-a5dd-0c328c8c2e73 => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 10:51:05.715940 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-6c5c2b7a-70c3-4538-8494-eac8d9a8816b tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] 10.222.0.30 "POST /compute/v2.1/servers/1e267da4-1e48-4136-babc-656ccd50aae2/action" status: 200 len: 14 microversion: 2.1 time: 0.088504 Dec 24 10:51:05.719107 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 490/974] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Dec 24 10:51:05 2021] POST /compute/v2.1/servers/1e267da4-1e48-4136-babc-656ccd50aae2/action => generated 14 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Dec 24 10:51:06.282047 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [req-9d09feca-2a1f-4a49-b2f8-d06335fc86a0 req-d36ba7d9-e35a-46a9-b7fe-4f11496da412 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd7d5e17-d089-4ff3-8b8e-bb2cb460ce5f", "name": "network-vif-deleted", "tag": "f7f94f7c-037f-4b6a-8285-ce790ac9221c"}]} {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:51:06.283616 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 10:51:06.283616 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: warnings.warn(msg) Dec 24 10:51:06.290956 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [req-9d09feca-2a1f-4a49-b2f8-d06335fc86a0 req-d36ba7d9-e35a-46a9-b7fe-4f11496da412 service nova] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:51:06.291446 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [req-9d09feca-2a1f-4a49-b2f8-d06335fc86a0 req-d36ba7d9-e35a-46a9-b7fe-4f11496da412 service nova] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:51:06.302724 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.compute.server_external_events [req-9d09feca-2a1f-4a49-b2f8-d06335fc86a0 req-d36ba7d9-e35a-46a9-b7fe-4f11496da412 service nova] Creating event network-vif-deleted:f7f94f7c-037f-4b6a-8285-ce790ac9221c for instance cd7d5e17-d089-4ff3-8b8e-bb2cb460ce5f on hv-cinder-81644 Dec 24 10:51:06.307783 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [req-9d09feca-2a1f-4a49-b2f8-d06335fc86a0 req-d36ba7d9-e35a-46a9-b7fe-4f11496da412 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033614 Dec 24 10:51:06.308850 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 485/975] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Dec 24 10:51:06 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 10:51:06.382607 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-5c19b65e-d421-4e35-a46f-3b4f0f3e5c68 tempest-VolumesActionsTest-1489615802 tempest-VolumesActionsTest-1489615802-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:51:06.383314 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-5c19b65e-d421-4e35-a46f-3b4f0f3e5c68 tempest-VolumesActionsTest-1489615802 tempest-VolumesActionsTest-1489615802-project] [instance: cd7d5e17-d089-4ff3-8b8e-bb2cb460ce5f] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:51:06.390808 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-5c19b65e-d421-4e35-a46f-3b4f0f3e5c68 tempest-VolumesActionsTest-1489615802 tempest-VolumesActionsTest-1489615802-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:51:06.391254 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-5c19b65e-d421-4e35-a46f-3b4f0f3e5c68 tempest-VolumesActionsTest-1489615802 tempest-VolumesActionsTest-1489615802-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:51:06.392286 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-5c19b65e-d421-4e35-a46f-3b4f0f3e5c68 tempest-VolumesActionsTest-1489615802 tempest-VolumesActionsTest-1489615802-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:51:06.392727 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-5c19b65e-d421-4e35-a46f-3b4f0f3e5c68 tempest-VolumesActionsTest-1489615802 tempest-VolumesActionsTest-1489615802-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:51:06.452692 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-5c19b65e-d421-4e35-a46f-3b4f0f3e5c68 tempest-VolumesActionsTest-1489615802 tempest-VolumesActionsTest-1489615802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b484152f59664123bf8c9d4c56bfebb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8a5fd5e33e4d059b152730ca60d5c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:51:06.460445 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-5c19b65e-d421-4e35-a46f-3b4f0f3e5c68 tempest-VolumesActionsTest-1489615802 tempest-VolumesActionsTest-1489615802-project] 10.222.0.30 "GET /compute/v2.1/servers/cd7d5e17-d089-4ff3-8b8e-bb2cb460ce5f" status: 200 len: 1459 microversion: 2.1 time: 0.081903 Dec 24 10:51:06.461040 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 491/976] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:51:06 2021] GET /compute/v2.1/servers/cd7d5e17-d089-4ff3-8b8e-bb2cb460ce5f => generated 1459 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:51:06.699790 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-aabcb6b6-496a-4229-bb94-54a5352178ec tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:51:06.700538 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-aabcb6b6-496a-4229-bb94-54a5352178ec tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] [instance: d2c0f276-f763-4337-a5dd-0c328c8c2e73] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:51:06.707234 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-aabcb6b6-496a-4229-bb94-54a5352178ec tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:51:06.707685 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-aabcb6b6-496a-4229-bb94-54a5352178ec tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:51:06.708460 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-aabcb6b6-496a-4229-bb94-54a5352178ec tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:51:06.708920 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-aabcb6b6-496a-4229-bb94-54a5352178ec tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:51:06.726655 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-55a14eba-286e-4cad-a120-359d0057b55a tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:51:06.727561 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-55a14eba-286e-4cad-a120-359d0057b55a tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] [instance: 1e267da4-1e48-4136-babc-656ccd50aae2] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:51:06.733994 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-55a14eba-286e-4cad-a120-359d0057b55a tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:51:06.734446 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-55a14eba-286e-4cad-a120-359d0057b55a tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:51:06.735273 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-55a14eba-286e-4cad-a120-359d0057b55a tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:51:06.735708 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-55a14eba-286e-4cad-a120-359d0057b55a tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:51:06.809062 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-55a14eba-286e-4cad-a120-359d0057b55a tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] 10.222.0.30 "POST /compute/v2.1/servers/1e267da4-1e48-4136-babc-656ccd50aae2/action" status: 200 len: 14 microversion: 2.1 time: 0.085938 Dec 24 10:51:06.809724 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 492/977] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Dec 24 10:51:06 2021] POST /compute/v2.1/servers/1e267da4-1e48-4136-babc-656ccd50aae2/action => generated 14 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Dec 24 10:51:06.839306 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-aabcb6b6-496a-4229-bb94-54a5352178ec tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:51:06.847292 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-aabcb6b6-496a-4229-bb94-54a5352178ec tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:51:06.848783 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-aabcb6b6-496a-4229-bb94-54a5352178ec tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:51:06.849958 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-aabcb6b6-496a-4229-bb94-54a5352178ec tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] 10.222.0.30 "GET /compute/v2.1/servers/d2c0f276-f763-4337-a5dd-0c328c8c2e73" status: 200 len: 1723 microversion: 2.20 time: 0.154820 Dec 24 10:51:06.850526 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 486/978] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Dec 24 10:51:06 2021] GET /compute/v2.1/servers/d2c0f276-f763-4337-a5dd-0c328c8c2e73 => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 10:51:06.987821 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-ef4e04f2-8ee3-4a19-a6f3-6d30129c9232 tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2c915293-fc86-490b-9fb0-9f6096090d39", "device": "/dev/sdb"}} {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:51:06.989696 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-ef4e04f2-8ee3-4a19-a6f3-6d30129c9232 tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] [instance: 90bed19f-dc1d-408e-8520-34e390ac92cd] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:51:07.003655 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-ef4e04f2-8ee3-4a19-a6f3-6d30129c9232 tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:51:07.003655 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-ef4e04f2-8ee3-4a19-a6f3-6d30129c9232 tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:51:07.003655 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-ef4e04f2-8ee3-4a19-a6f3-6d30129c9232 tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:51:07.003655 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-ef4e04f2-8ee3-4a19-a6f3-6d30129c9232 tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:51:07.477544 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-ffbab213-b9af-4f80-ad72-5ae63e3b0318 tempest-VolumesActionsTest-1489615802 tempest-VolumesActionsTest-1489615802-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:51:07.478159 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-ffbab213-b9af-4f80-ad72-5ae63e3b0318 tempest-VolumesActionsTest-1489615802 tempest-VolumesActionsTest-1489615802-project] [instance: cd7d5e17-d089-4ff3-8b8e-bb2cb460ce5f] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:51:07.485242 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-ffbab213-b9af-4f80-ad72-5ae63e3b0318 tempest-VolumesActionsTest-1489615802 tempest-VolumesActionsTest-1489615802-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:51:07.488117 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-ffbab213-b9af-4f80-ad72-5ae63e3b0318 tempest-VolumesActionsTest-1489615802 tempest-VolumesActionsTest-1489615802-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:51:07.488117 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-ffbab213-b9af-4f80-ad72-5ae63e3b0318 tempest-VolumesActionsTest-1489615802 tempest-VolumesActionsTest-1489615802-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:51:07.488117 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-ffbab213-b9af-4f80-ad72-5ae63e3b0318 tempest-VolumesActionsTest-1489615802 tempest-VolumesActionsTest-1489615802-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:51:07.499443 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.wsgi [None req-ffbab213-b9af-4f80-ad72-5ae63e3b0318 tempest-VolumesActionsTest-1489615802 tempest-VolumesActionsTest-1489615802-project] HTTP exception thrown: Instance cd7d5e17-d089-4ff3-8b8e-bb2cb460ce5f could not be found. Dec 24 10:51:07.500020 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-ffbab213-b9af-4f80-ad72-5ae63e3b0318 tempest-VolumesActionsTest-1489615802 tempest-VolumesActionsTest-1489615802-project] Returning 404 to user: Instance cd7d5e17-d089-4ff3-8b8e-bb2cb460ce5f could not be found. {{(pid=123431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 24 10:51:07.500837 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-ffbab213-b9af-4f80-ad72-5ae63e3b0318 tempest-VolumesActionsTest-1489615802 tempest-VolumesActionsTest-1489615802-project] 10.222.0.30 "GET /compute/v2.1/servers/cd7d5e17-d089-4ff3-8b8e-bb2cb460ce5f" status: 404 len: 111 microversion: 2.1 time: 0.027109 Dec 24 10:51:07.501360 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 487/979] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:51:07 2021] GET /compute/v2.1/servers/cd7d5e17-d089-4ff3-8b8e-bb2cb460ce5f => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Dec 24 10:51:07.822089 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-9c9624eb-2d1d-437f-9a5a-7643c4fb4f7d tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:51:07.823158 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-9c9624eb-2d1d-437f-9a5a-7643c4fb4f7d tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] [instance: 1e267da4-1e48-4136-babc-656ccd50aae2] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:51:07.828712 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-9c9624eb-2d1d-437f-9a5a-7643c4fb4f7d tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:51:07.829640 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-9c9624eb-2d1d-437f-9a5a-7643c4fb4f7d tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:51:07.830436 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-9c9624eb-2d1d-437f-9a5a-7643c4fb4f7d tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:51:07.830874 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-9c9624eb-2d1d-437f-9a5a-7643c4fb4f7d tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:51:07.895198 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-9c9624eb-2d1d-437f-9a5a-7643c4fb4f7d tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] 10.222.0.30 "POST /compute/v2.1/servers/1e267da4-1e48-4136-babc-656ccd50aae2/action" status: 200 len: 14 microversion: 2.1 time: 0.077190 Dec 24 10:51:07.895839 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 488/980] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Dec 24 10:51:07 2021] POST /compute/v2.1/servers/1e267da4-1e48-4136-babc-656ccd50aae2/action => generated 14 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 24 10:51:07.900861 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-3027979b-8062-46b8-a530-b75060cd2d8c tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:51:07.901541 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-3027979b-8062-46b8-a530-b75060cd2d8c tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] [instance: d2c0f276-f763-4337-a5dd-0c328c8c2e73] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:51:07.908353 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-3027979b-8062-46b8-a530-b75060cd2d8c tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:51:07.908797 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-3027979b-8062-46b8-a530-b75060cd2d8c tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:51:07.909650 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-3027979b-8062-46b8-a530-b75060cd2d8c tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:51:07.910034 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-3027979b-8062-46b8-a530-b75060cd2d8c tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:51:08.008532 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-ef4e04f2-8ee3-4a19-a6f3-6d30129c9232 tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] 10.222.0.30 "POST /compute/v2.1/servers/90bed19f-dc1d-408e-8520-34e390ac92cd/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.024566 Dec 24 10:51:08.009703 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 493/981] 10.222.0.30 () {60 vars in 1322 bytes} [Fri Dec 24 10:51:06 2021] POST /compute/v2.1/servers/90bed19f-dc1d-408e-8520-34e390ac92cd/os-volume_attachments => generated 194 bytes in 1027 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 10:51:08.069102 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-3027979b-8062-46b8-a530-b75060cd2d8c tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:51:08.078226 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-3027979b-8062-46b8-a530-b75060cd2d8c tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:51:08.080625 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-3027979b-8062-46b8-a530-b75060cd2d8c tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:51:08.086111 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-3027979b-8062-46b8-a530-b75060cd2d8c tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] 10.222.0.30 "GET /compute/v2.1/servers/d2c0f276-f763-4337-a5dd-0c328c8c2e73" status: 200 len: 1723 microversion: 2.20 time: 0.186264 Dec 24 10:51:08.086111 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 489/982] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Dec 24 10:51:07 2021] GET /compute/v2.1/servers/d2c0f276-f763-4337-a5dd-0c328c8c2e73 => generated 1723 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 10:51:08.906860 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-fb33482b-8199-47e9-9e42-f2ee11a7e786 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:51:08.907898 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-fb33482b-8199-47e9-9e42-f2ee11a7e786 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] [instance: 1e267da4-1e48-4136-babc-656ccd50aae2] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:51:08.915357 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-fb33482b-8199-47e9-9e42-f2ee11a7e786 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:51:08.923993 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-fb33482b-8199-47e9-9e42-f2ee11a7e786 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:51:08.923993 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-fb33482b-8199-47e9-9e42-f2ee11a7e786 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:51:08.923993 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-fb33482b-8199-47e9-9e42-f2ee11a7e786 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:51:08.997126 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-fb33482b-8199-47e9-9e42-f2ee11a7e786 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] 10.222.0.30 "POST /compute/v2.1/servers/1e267da4-1e48-4136-babc-656ccd50aae2/action" status: 200 len: 14 microversion: 2.1 time: 0.094095 Dec 24 10:51:08.998039 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 494/983] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Dec 24 10:51:08 2021] POST /compute/v2.1/servers/1e267da4-1e48-4136-babc-656ccd50aae2/action => generated 14 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 24 10:51:09.103068 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-4fbb3596-fc6e-4027-93b8-d623cba7f924 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:51:09.104162 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-4fbb3596-fc6e-4027-93b8-d623cba7f924 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] [instance: d2c0f276-f763-4337-a5dd-0c328c8c2e73] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:51:09.120874 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-4fbb3596-fc6e-4027-93b8-d623cba7f924 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:51:09.121322 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-4fbb3596-fc6e-4027-93b8-d623cba7f924 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:51:09.122110 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-4fbb3596-fc6e-4027-93b8-d623cba7f924 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:51:09.122566 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-4fbb3596-fc6e-4027-93b8-d623cba7f924 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:51:09.248438 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-4fbb3596-fc6e-4027-93b8-d623cba7f924 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:51:09.256019 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-4fbb3596-fc6e-4027-93b8-d623cba7f924 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:51:09.257550 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-4fbb3596-fc6e-4027-93b8-d623cba7f924 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:51:09.258695 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-4fbb3596-fc6e-4027-93b8-d623cba7f924 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] 10.222.0.30 "GET /compute/v2.1/servers/d2c0f276-f763-4337-a5dd-0c328c8c2e73" status: 200 len: 1723 microversion: 2.20 time: 0.159326 Dec 24 10:51:09.259259 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 490/984] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Dec 24 10:51:09 2021] GET /compute/v2.1/servers/d2c0f276-f763-4337-a5dd-0c328c8c2e73 => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 10:51:10.007838 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-4a53f7b5-505a-4676-a9df-2c96f733190c tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:51:10.008858 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-4a53f7b5-505a-4676-a9df-2c96f733190c tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] [instance: 1e267da4-1e48-4136-babc-656ccd50aae2] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:51:10.015694 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-4a53f7b5-505a-4676-a9df-2c96f733190c tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:51:10.016134 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-4a53f7b5-505a-4676-a9df-2c96f733190c tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:51:10.017184 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-4a53f7b5-505a-4676-a9df-2c96f733190c tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:51:10.017624 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-4a53f7b5-505a-4676-a9df-2c96f733190c tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:51:10.277644 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-a45f1e39-4fd7-4547-bda2-a7fb264b82a0 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:51:10.278266 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-a45f1e39-4fd7-4547-bda2-a7fb264b82a0 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] [instance: d2c0f276-f763-4337-a5dd-0c328c8c2e73] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:51:10.284545 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-a45f1e39-4fd7-4547-bda2-a7fb264b82a0 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:51:10.285030 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-a45f1e39-4fd7-4547-bda2-a7fb264b82a0 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:51:10.285799 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-a45f1e39-4fd7-4547-bda2-a7fb264b82a0 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:51:10.286230 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-a45f1e39-4fd7-4547-bda2-a7fb264b82a0 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:51:10.410907 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-a45f1e39-4fd7-4547-bda2-a7fb264b82a0 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:51:10.419178 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-a45f1e39-4fd7-4547-bda2-a7fb264b82a0 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:51:10.420648 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-a45f1e39-4fd7-4547-bda2-a7fb264b82a0 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:51:10.421806 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-a45f1e39-4fd7-4547-bda2-a7fb264b82a0 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] 10.222.0.30 "GET /compute/v2.1/servers/d2c0f276-f763-4337-a5dd-0c328c8c2e73" status: 200 len: 1723 microversion: 2.20 time: 0.148362 Dec 24 10:51:10.422368 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 491/985] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Dec 24 10:51:10 2021] GET /compute/v2.1/servers/d2c0f276-f763-4337-a5dd-0c328c8c2e73 => generated 1723 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 24 10:51:10.975374 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-27c15f75-461e-41fa-a8a6-673f1afe39fc tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:51:10.975858 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-27c15f75-461e-41fa-a8a6-673f1afe39fc tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] [instance: 91615e87-1e43-4d69-baab-d7af897d1ac3] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:51:10.985034 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-27c15f75-461e-41fa-a8a6-673f1afe39fc tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:51:10.985474 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-27c15f75-461e-41fa-a8a6-673f1afe39fc tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:51:10.986247 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-27c15f75-461e-41fa-a8a6-673f1afe39fc tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:51:10.986671 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-27c15f75-461e-41fa-a8a6-673f1afe39fc tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:51:11.015603 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-27c15f75-461e-41fa-a8a6-673f1afe39fc tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] [instance: 91615e87-1e43-4d69-baab-d7af897d1ac3] Going to try to terminate instance {{(pid=123431) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 24 10:51:11.272007 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-27c15f75-461e-41fa-a8a6-673f1afe39fc tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] 10.222.0.30 "DELETE /compute/v2.1/servers/91615e87-1e43-4d69-baab-d7af897d1ac3" status: 204 len: 0 microversion: 2.1 time: 0.299943 Dec 24 10:51:11.272582 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 492/986] 10.222.0.30 () {58 vars in 1238 bytes} [Fri Dec 24 10:51:10 2021] DELETE /compute/v2.1/servers/91615e87-1e43-4d69-baab-d7af897d1ac3 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Dec 24 10:51:11.280775 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-e9e0964f-b316-4bed-a5c2-1aaef18859bb tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:51:11.281578 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-e9e0964f-b316-4bed-a5c2-1aaef18859bb tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] [instance: 91615e87-1e43-4d69-baab-d7af897d1ac3] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:51:11.287131 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-e9e0964f-b316-4bed-a5c2-1aaef18859bb tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:51:11.287569 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-e9e0964f-b316-4bed-a5c2-1aaef18859bb tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:51:11.288326 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-e9e0964f-b316-4bed-a5c2-1aaef18859bb tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:51:11.288756 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-e9e0964f-b316-4bed-a5c2-1aaef18859bb tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:51:11.419202 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-e9e0964f-b316-4bed-a5c2-1aaef18859bb tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b690a952a1704197baf5e653e27160f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0fd34670674906aa9a61200251b76c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:51:11.426398 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-e9e0964f-b316-4bed-a5c2-1aaef18859bb tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] 10.222.0.30 "GET /compute/v2.1/servers/91615e87-1e43-4d69-baab-d7af897d1ac3" status: 200 len: 1577 microversion: 2.1 time: 0.149246 Dec 24 10:51:11.426966 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 493/987] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:51:11 2021] GET /compute/v2.1/servers/91615e87-1e43-4d69-baab-d7af897d1ac3 => generated 1577 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 24 10:51:11.438873 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-a21803cf-6223-4373-b39a-701960358447 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:51:11.439445 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-a21803cf-6223-4373-b39a-701960358447 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] [instance: d2c0f276-f763-4337-a5dd-0c328c8c2e73] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:51:11.445061 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-a21803cf-6223-4373-b39a-701960358447 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:51:11.445505 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-a21803cf-6223-4373-b39a-701960358447 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:51:11.446276 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-a21803cf-6223-4373-b39a-701960358447 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:51:11.446709 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-a21803cf-6223-4373-b39a-701960358447 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:51:11.570161 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-a21803cf-6223-4373-b39a-701960358447 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:51:11.578259 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-a21803cf-6223-4373-b39a-701960358447 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:51:11.579754 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-a21803cf-6223-4373-b39a-701960358447 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:51:11.580932 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-a21803cf-6223-4373-b39a-701960358447 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] 10.222.0.30 "GET /compute/v2.1/servers/d2c0f276-f763-4337-a5dd-0c328c8c2e73" status: 200 len: 1723 microversion: 2.20 time: 0.145591 Dec 24 10:51:11.581499 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 494/988] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Dec 24 10:51:11 2021] GET /compute/v2.1/servers/d2c0f276-f763-4337-a5dd-0c328c8c2e73 => generated 1723 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 24 10:51:12.029692 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-4a53f7b5-505a-4676-a9df-2c96f733190c tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] 10.222.0.30 "POST /compute/v2.1/servers/1e267da4-1e48-4136-babc-656ccd50aae2/action" status: 200 len: 14 microversion: 2.1 time: 2.025665 Dec 24 10:51:12.037556 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 495/989] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Dec 24 10:51:10 2021] POST /compute/v2.1/servers/1e267da4-1e48-4136-babc-656ccd50aae2/action => generated 14 bytes in 2027 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 24 10:51:12.443485 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-11ff29db-232c-48d4-8dd5-40ea73a2e0a0 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:51:12.444314 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-11ff29db-232c-48d4-8dd5-40ea73a2e0a0 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] [instance: 91615e87-1e43-4d69-baab-d7af897d1ac3] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:51:12.451428 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-11ff29db-232c-48d4-8dd5-40ea73a2e0a0 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:51:12.451809 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-11ff29db-232c-48d4-8dd5-40ea73a2e0a0 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:51:12.452604 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-11ff29db-232c-48d4-8dd5-40ea73a2e0a0 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:51:12.453190 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-11ff29db-232c-48d4-8dd5-40ea73a2e0a0 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:51:12.599892 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-eb369b18-ec94-4eaf-9bd1-6ff1551dccd5 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:51:12.600861 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-eb369b18-ec94-4eaf-9bd1-6ff1551dccd5 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] [instance: d2c0f276-f763-4337-a5dd-0c328c8c2e73] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:51:12.610141 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-eb369b18-ec94-4eaf-9bd1-6ff1551dccd5 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:51:12.610710 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-eb369b18-ec94-4eaf-9bd1-6ff1551dccd5 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:51:12.611492 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-eb369b18-ec94-4eaf-9bd1-6ff1551dccd5 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:51:12.611917 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-eb369b18-ec94-4eaf-9bd1-6ff1551dccd5 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:51:12.673368 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-11ff29db-232c-48d4-8dd5-40ea73a2e0a0 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b690a952a1704197baf5e653e27160f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0fd34670674906aa9a61200251b76c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:51:12.680971 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-11ff29db-232c-48d4-8dd5-40ea73a2e0a0 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] 10.222.0.30 "GET /compute/v2.1/servers/91615e87-1e43-4d69-baab-d7af897d1ac3" status: 200 len: 1577 microversion: 2.1 time: 0.241204 Dec 24 10:51:12.682340 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 495/990] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:51:12 2021] GET /compute/v2.1/servers/91615e87-1e43-4d69-baab-d7af897d1ac3 => generated 1577 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:51:12.742335 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-eb369b18-ec94-4eaf-9bd1-6ff1551dccd5 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:51:12.751118 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-eb369b18-ec94-4eaf-9bd1-6ff1551dccd5 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:51:12.752873 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-eb369b18-ec94-4eaf-9bd1-6ff1551dccd5 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:51:12.754040 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-eb369b18-ec94-4eaf-9bd1-6ff1551dccd5 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] 10.222.0.30 "GET /compute/v2.1/servers/d2c0f276-f763-4337-a5dd-0c328c8c2e73" status: 200 len: 1723 microversion: 2.20 time: 0.158385 Dec 24 10:51:12.754598 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 496/991] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Dec 24 10:51:12 2021] GET /compute/v2.1/servers/d2c0f276-f763-4337-a5dd-0c328c8c2e73 => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 24 10:51:13.043343 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-98d1d99a-02d4-4f7f-ba15-2e271cf6dc69 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:51:13.044368 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-98d1d99a-02d4-4f7f-ba15-2e271cf6dc69 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] [instance: 1e267da4-1e48-4136-babc-656ccd50aae2] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:51:13.050344 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-98d1d99a-02d4-4f7f-ba15-2e271cf6dc69 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:51:13.050894 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-98d1d99a-02d4-4f7f-ba15-2e271cf6dc69 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:51:13.051793 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-98d1d99a-02d4-4f7f-ba15-2e271cf6dc69 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:51:13.052151 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-98d1d99a-02d4-4f7f-ba15-2e271cf6dc69 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:51:13.126621 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-98d1d99a-02d4-4f7f-ba15-2e271cf6dc69 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] 10.222.0.30 "POST /compute/v2.1/servers/1e267da4-1e48-4136-babc-656ccd50aae2/action" status: 200 len: 14 microversion: 2.1 time: 0.087979 Dec 24 10:51:13.127328 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 496/992] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Dec 24 10:51:13 2021] POST /compute/v2.1/servers/1e267da4-1e48-4136-babc-656ccd50aae2/action => generated 14 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Dec 24 10:51:13.701766 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-7e1e29e9-f9a7-4d0a-8276-e659511cee9b tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:51:13.702538 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-7e1e29e9-f9a7-4d0a-8276-e659511cee9b tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] [instance: 91615e87-1e43-4d69-baab-d7af897d1ac3] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:51:13.711735 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-7e1e29e9-f9a7-4d0a-8276-e659511cee9b tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:51:13.712722 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-7e1e29e9-f9a7-4d0a-8276-e659511cee9b tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:51:13.713726 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-7e1e29e9-f9a7-4d0a-8276-e659511cee9b tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:51:13.714684 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-7e1e29e9-f9a7-4d0a-8276-e659511cee9b tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:51:13.773706 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-261ca31c-b916-4694-8db1-26ce7549ad17 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:51:13.775158 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-261ca31c-b916-4694-8db1-26ce7549ad17 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] [instance: d2c0f276-f763-4337-a5dd-0c328c8c2e73] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:51:13.788855 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-261ca31c-b916-4694-8db1-26ce7549ad17 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:51:13.789591 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-261ca31c-b916-4694-8db1-26ce7549ad17 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:51:13.797667 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-261ca31c-b916-4694-8db1-26ce7549ad17 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:51:13.798119 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-261ca31c-b916-4694-8db1-26ce7549ad17 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:51:13.929595 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-7e1e29e9-f9a7-4d0a-8276-e659511cee9b tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b690a952a1704197baf5e653e27160f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0fd34670674906aa9a61200251b76c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:51:13.939375 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-7e1e29e9-f9a7-4d0a-8276-e659511cee9b tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] 10.222.0.30 "GET /compute/v2.1/servers/91615e87-1e43-4d69-baab-d7af897d1ac3" status: 200 len: 1577 microversion: 2.1 time: 0.242938 Dec 24 10:51:13.949923 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 497/993] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:51:13 2021] GET /compute/v2.1/servers/91615e87-1e43-4d69-baab-d7af897d1ac3 => generated 1577 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:51:14.133852 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-261ca31c-b916-4694-8db1-26ce7549ad17 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:51:14.138647 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-9c82f6df-524d-45bb-9c43-a364849f9b8b tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:51:14.140303 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-9c82f6df-524d-45bb-9c43-a364849f9b8b tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] [instance: 1e267da4-1e48-4136-babc-656ccd50aae2] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:51:14.143663 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-261ca31c-b916-4694-8db1-26ce7549ad17 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:51:14.145239 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-261ca31c-b916-4694-8db1-26ce7549ad17 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:51:14.146592 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-261ca31c-b916-4694-8db1-26ce7549ad17 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] 10.222.0.30 "GET /compute/v2.1/servers/d2c0f276-f763-4337-a5dd-0c328c8c2e73" status: 200 len: 1744 microversion: 2.20 time: 0.376968 Dec 24 10:51:14.147106 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 497/994] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Dec 24 10:51:13 2021] GET /compute/v2.1/servers/d2c0f276-f763-4337-a5dd-0c328c8c2e73 => generated 1744 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 10:51:14.150629 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-9c82f6df-524d-45bb-9c43-a364849f9b8b tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:51:14.151632 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-9c82f6df-524d-45bb-9c43-a364849f9b8b tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:51:14.153150 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-9c82f6df-524d-45bb-9c43-a364849f9b8b tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:51:14.153628 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-9c82f6df-524d-45bb-9c43-a364849f9b8b tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:51:14.249550 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-9c82f6df-524d-45bb-9c43-a364849f9b8b tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] 10.222.0.30 "POST /compute/v2.1/servers/1e267da4-1e48-4136-babc-656ccd50aae2/action" status: 200 len: 14 microversion: 2.1 time: 0.114790 Dec 24 10:51:14.250690 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 498/995] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Dec 24 10:51:14 2021] POST /compute/v2.1/servers/1e267da4-1e48-4136-babc-656ccd50aae2/action => generated 14 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Dec 24 10:51:14.957121 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-4b3e5b89-6656-4ecd-88ac-3b20bb8245ca tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:51:14.958773 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-4b3e5b89-6656-4ecd-88ac-3b20bb8245ca tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] [instance: 91615e87-1e43-4d69-baab-d7af897d1ac3] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:51:14.967526 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-4b3e5b89-6656-4ecd-88ac-3b20bb8245ca tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:51:14.968561 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-4b3e5b89-6656-4ecd-88ac-3b20bb8245ca tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:51:14.970348 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-4b3e5b89-6656-4ecd-88ac-3b20bb8245ca tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:51:14.971064 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-4b3e5b89-6656-4ecd-88ac-3b20bb8245ca tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:51:15.100301 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-4b3e5b89-6656-4ecd-88ac-3b20bb8245ca tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b690a952a1704197baf5e653e27160f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0fd34670674906aa9a61200251b76c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:51:15.109047 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-4b3e5b89-6656-4ecd-88ac-3b20bb8245ca tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] 10.222.0.30 "GET /compute/v2.1/servers/91615e87-1e43-4d69-baab-d7af897d1ac3" status: 200 len: 1509 microversion: 2.1 time: 0.155875 Dec 24 10:51:15.119617 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 498/996] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:51:14 2021] GET /compute/v2.1/servers/91615e87-1e43-4d69-baab-d7af897d1ac3 => generated 1509 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 24 10:51:15.174990 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-f0de7548-ea6a-4009-945d-d01f2b0ad7ed tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:51:15.176579 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-f0de7548-ea6a-4009-945d-d01f2b0ad7ed tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] [instance: d2c0f276-f763-4337-a5dd-0c328c8c2e73] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:51:15.184716 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-f0de7548-ea6a-4009-945d-d01f2b0ad7ed tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:51:15.185607 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-f0de7548-ea6a-4009-945d-d01f2b0ad7ed tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:51:15.186840 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-f0de7548-ea6a-4009-945d-d01f2b0ad7ed tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:51:15.187447 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-f0de7548-ea6a-4009-945d-d01f2b0ad7ed tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:51:15.261397 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-1fa1223a-baab-4a5d-ba27-9c28e17a1654 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:51:15.262344 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-1fa1223a-baab-4a5d-ba27-9c28e17a1654 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] [instance: 1e267da4-1e48-4136-babc-656ccd50aae2] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:51:15.273112 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-1fa1223a-baab-4a5d-ba27-9c28e17a1654 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:51:15.276619 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-1fa1223a-baab-4a5d-ba27-9c28e17a1654 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:51:15.277585 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-1fa1223a-baab-4a5d-ba27-9c28e17a1654 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:51:15.278105 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-1fa1223a-baab-4a5d-ba27-9c28e17a1654 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:51:15.412034 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-1fa1223a-baab-4a5d-ba27-9c28e17a1654 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] 10.222.0.30 "POST /compute/v2.1/servers/1e267da4-1e48-4136-babc-656ccd50aae2/action" status: 200 len: 6451 microversion: 2.1 time: 0.154727 Dec 24 10:51:15.415057 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 499/997] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Dec 24 10:51:15 2021] POST /compute/v2.1/servers/1e267da4-1e48-4136-babc-656ccd50aae2/action => generated 6451 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:51:15.421331 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [req-a71698c7-22d6-4914-83e9-8140ccce3135 req-f1ddbc40-7bb8-4ac6-aea7-7d9cb70386ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91615e87-1e43-4d69-baab-d7af897d1ac3", "name": "network-vif-deleted", "tag": "85e920ef-bc3e-40d9-a188-7900892566bf"}]} {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:51:15.427149 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 10:51:15.427149 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: warnings.warn(msg) Dec 24 10:51:15.467724 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-f0de7548-ea6a-4009-945d-d01f2b0ad7ed tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:51:15.476144 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-f0de7548-ea6a-4009-945d-d01f2b0ad7ed tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:51:15.479459 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [req-a71698c7-22d6-4914-83e9-8140ccce3135 req-f1ddbc40-7bb8-4ac6-aea7-7d9cb70386ad service nova] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:51:15.479971 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [req-a71698c7-22d6-4914-83e9-8140ccce3135 req-f1ddbc40-7bb8-4ac6-aea7-7d9cb70386ad service nova] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:51:15.484567 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-f0de7548-ea6a-4009-945d-d01f2b0ad7ed tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:51:15.485910 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-f0de7548-ea6a-4009-945d-d01f2b0ad7ed tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] 10.222.0.30 "GET /compute/v2.1/servers/d2c0f276-f763-4337-a5dd-0c328c8c2e73" status: 200 len: 1744 microversion: 2.20 time: 0.320601 Dec 24 10:51:15.489489 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 499/998] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Dec 24 10:51:15 2021] GET /compute/v2.1/servers/d2c0f276-f763-4337-a5dd-0c328c8c2e73 => generated 1744 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 10:51:15.501633 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.compute.server_external_events [req-a71698c7-22d6-4914-83e9-8140ccce3135 req-f1ddbc40-7bb8-4ac6-aea7-7d9cb70386ad service nova] Creating event network-vif-deleted:85e920ef-bc3e-40d9-a188-7900892566bf for instance 91615e87-1e43-4d69-baab-d7af897d1ac3 on hv-cinder-81644 Dec 24 10:51:15.510705 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [req-a71698c7-22d6-4914-83e9-8140ccce3135 req-f1ddbc40-7bb8-4ac6-aea7-7d9cb70386ad service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092070 Dec 24 10:51:15.512298 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 500/999] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Dec 24 10:51:15 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 10:51:16.128293 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-c23fdec4-47d9-49d7-98f1-6a236b0eeacc tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:51:16.128998 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-c23fdec4-47d9-49d7-98f1-6a236b0eeacc tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] [instance: 91615e87-1e43-4d69-baab-d7af897d1ac3] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:51:16.142497 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-c23fdec4-47d9-49d7-98f1-6a236b0eeacc tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:51:16.142946 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-c23fdec4-47d9-49d7-98f1-6a236b0eeacc tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:51:16.143748 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-c23fdec4-47d9-49d7-98f1-6a236b0eeacc tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:51:16.144189 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-c23fdec4-47d9-49d7-98f1-6a236b0eeacc tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:51:16.217550 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-c23fdec4-47d9-49d7-98f1-6a236b0eeacc tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b690a952a1704197baf5e653e27160f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0fd34670674906aa9a61200251b76c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:51:16.227927 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-c23fdec4-47d9-49d7-98f1-6a236b0eeacc tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] 10.222.0.30 "GET /compute/v2.1/servers/91615e87-1e43-4d69-baab-d7af897d1ac3" status: 200 len: 1224 microversion: 2.1 time: 0.105011 Dec 24 10:51:16.229965 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 500/1000] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:51:16 2021] GET /compute/v2.1/servers/91615e87-1e43-4d69-baab-d7af897d1ac3 => generated 1224 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 24 10:51:16.427661 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-88b8344b-24a4-4400-b7b0-f77f8831912d tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:51:16.428671 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-88b8344b-24a4-4400-b7b0-f77f8831912d tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] [instance: 1e267da4-1e48-4136-babc-656ccd50aae2] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:51:16.445832 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-88b8344b-24a4-4400-b7b0-f77f8831912d tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:51:16.446414 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-88b8344b-24a4-4400-b7b0-f77f8831912d tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:51:16.447566 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-88b8344b-24a4-4400-b7b0-f77f8831912d tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:51:16.448161 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-88b8344b-24a4-4400-b7b0-f77f8831912d tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:51:16.508446 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-c2284271-90fe-46df-a181-ca2136501f52 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:51:16.509108 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-c2284271-90fe-46df-a181-ca2136501f52 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] [instance: d2c0f276-f763-4337-a5dd-0c328c8c2e73] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:51:16.526075 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-c2284271-90fe-46df-a181-ca2136501f52 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:51:16.526075 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-c2284271-90fe-46df-a181-ca2136501f52 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:51:16.526075 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-c2284271-90fe-46df-a181-ca2136501f52 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:51:16.526075 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-c2284271-90fe-46df-a181-ca2136501f52 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:51:16.547136 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-88b8344b-24a4-4400-b7b0-f77f8831912d tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] 10.222.0.30 "POST /compute/v2.1/servers/1e267da4-1e48-4136-babc-656ccd50aae2/action" status: 200 len: 12971 microversion: 2.1 time: 0.124540 Dec 24 10:51:16.548501 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 501/1001] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Dec 24 10:51:16 2021] POST /compute/v2.1/servers/1e267da4-1e48-4136-babc-656ccd50aae2/action => generated 12971 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 24 10:51:16.701133 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-c2284271-90fe-46df-a181-ca2136501f52 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:51:16.726194 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-c2284271-90fe-46df-a181-ca2136501f52 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:51:16.740506 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-c2284271-90fe-46df-a181-ca2136501f52 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:51:16.740506 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-c2284271-90fe-46df-a181-ca2136501f52 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] 10.222.0.30 "GET /compute/v2.1/servers/d2c0f276-f763-4337-a5dd-0c328c8c2e73" status: 200 len: 1739 microversion: 2.20 time: 0.225106 Dec 24 10:51:16.740506 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 501/1002] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Dec 24 10:51:16 2021] GET /compute/v2.1/servers/d2c0f276-f763-4337-a5dd-0c328c8c2e73 => generated 1739 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 24 10:51:17.245745 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-1291e3f0-6049-436c-8e4b-bab9c6786a53 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:51:17.246880 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-1291e3f0-6049-436c-8e4b-bab9c6786a53 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] [instance: 91615e87-1e43-4d69-baab-d7af897d1ac3] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:51:17.264719 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-1291e3f0-6049-436c-8e4b-bab9c6786a53 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:51:17.265579 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-1291e3f0-6049-436c-8e4b-bab9c6786a53 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:51:17.266611 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-1291e3f0-6049-436c-8e4b-bab9c6786a53 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:51:17.267525 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-1291e3f0-6049-436c-8e4b-bab9c6786a53 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:51:17.393765 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-1291e3f0-6049-436c-8e4b-bab9c6786a53 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:51:17.394661 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-1291e3f0-6049-436c-8e4b-bab9c6786a53 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:51:17.401693 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.objects.instance [None req-1291e3f0-6049-436c-8e4b-bab9c6786a53 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lazy-loading 'fault' on Instance uuid 91615e87-1e43-4d69-baab-d7af897d1ac3 {{(pid=123431) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 24 10:51:17.506127 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-1291e3f0-6049-436c-8e4b-bab9c6786a53 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b690a952a1704197baf5e653e27160f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0fd34670674906aa9a61200251b76c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:51:17.519814 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-1291e3f0-6049-436c-8e4b-bab9c6786a53 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] 10.222.0.30 "GET /compute/v2.1/servers/91615e87-1e43-4d69-baab-d7af897d1ac3" status: 200 len: 1229 microversion: 2.1 time: 0.278045 Dec 24 10:51:17.523063 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 502/1003] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:51:17 2021] GET /compute/v2.1/servers/91615e87-1e43-4d69-baab-d7af897d1ac3 => generated 1229 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:51:17.558774 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-4148999d-06f6-4262-a74a-2045a3ee0723 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:51:17.561587 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-4148999d-06f6-4262-a74a-2045a3ee0723 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] [instance: 1e267da4-1e48-4136-babc-656ccd50aae2] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:51:17.589043 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-4148999d-06f6-4262-a74a-2045a3ee0723 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:51:17.590081 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-4148999d-06f6-4262-a74a-2045a3ee0723 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:51:17.591198 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-4148999d-06f6-4262-a74a-2045a3ee0723 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:51:17.591821 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-4148999d-06f6-4262-a74a-2045a3ee0723 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:51:17.746102 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-4148999d-06f6-4262-a74a-2045a3ee0723 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] 10.222.0.30 "POST /compute/v2.1/servers/1e267da4-1e48-4136-babc-656ccd50aae2/action" status: 200 len: 18155 microversion: 2.1 time: 0.190692 Dec 24 10:51:17.750021 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 502/1004] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Dec 24 10:51:17 2021] POST /compute/v2.1/servers/1e267da4-1e48-4136-babc-656ccd50aae2/action => generated 18155 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 24 10:51:17.751801 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-64db1e5d-5c43-40ab-8722-ff4d1574a475 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:51:17.752838 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-64db1e5d-5c43-40ab-8722-ff4d1574a475 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] [instance: d2c0f276-f763-4337-a5dd-0c328c8c2e73] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:51:17.770074 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-64db1e5d-5c43-40ab-8722-ff4d1574a475 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:51:17.771060 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-64db1e5d-5c43-40ab-8722-ff4d1574a475 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:51:17.772236 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-64db1e5d-5c43-40ab-8722-ff4d1574a475 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:51:17.775588 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-64db1e5d-5c43-40ab-8722-ff4d1574a475 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:51:17.997494 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-64db1e5d-5c43-40ab-8722-ff4d1574a475 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:51:18.013569 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-64db1e5d-5c43-40ab-8722-ff4d1574a475 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:51:18.015173 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-64db1e5d-5c43-40ab-8722-ff4d1574a475 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:51:18.021166 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-64db1e5d-5c43-40ab-8722-ff4d1574a475 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] 10.222.0.30 "GET /compute/v2.1/servers/d2c0f276-f763-4337-a5dd-0c328c8c2e73" status: 200 len: 1739 microversion: 2.20 time: 0.275653 Dec 24 10:51:18.021482 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 503/1005] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Dec 24 10:51:17 2021] GET /compute/v2.1/servers/d2c0f276-f763-4337-a5dd-0c328c8c2e73 => generated 1739 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 24 10:51:18.380296 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [req-ed4e5866-7020-499c-8753-d106f3e098a6 req-1f35fa55-583e-4436-8081-6ade32fbe398 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2c0f276-f763-4337-a5dd-0c328c8c2e73", "name": "network-vif-plugged", "status": "completed", "tag": "4043d4f5-4811-4ba4-8723-4f04e5548d1c"}]} {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:51:18.382198 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 10:51:18.382198 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: warnings.warn(msg) Dec 24 10:51:18.399512 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [req-ed4e5866-7020-499c-8753-d106f3e098a6 req-1f35fa55-583e-4436-8081-6ade32fbe398 service nova] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:51:18.400287 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [req-ed4e5866-7020-499c-8753-d106f3e098a6 req-1f35fa55-583e-4436-8081-6ade32fbe398 service nova] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:51:18.432005 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.compute.server_external_events [req-ed4e5866-7020-499c-8753-d106f3e098a6 req-1f35fa55-583e-4436-8081-6ade32fbe398 service nova] Creating event network-vif-plugged:4043d4f5-4811-4ba4-8723-4f04e5548d1c for instance d2c0f276-f763-4337-a5dd-0c328c8c2e73 on hv-cinder-81644 Dec 24 10:51:18.458877 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [req-ed4e5866-7020-499c-8753-d106f3e098a6 req-1f35fa55-583e-4436-8081-6ade32fbe398 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078459 Dec 24 10:51:18.459872 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 503/1006] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Dec 24 10:51:18 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 10:51:18.540160 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-9ffc43d6-5f38-4c26-9f50-b2563ac1fba5 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:51:18.541611 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-9ffc43d6-5f38-4c26-9f50-b2563ac1fba5 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] [instance: 91615e87-1e43-4d69-baab-d7af897d1ac3] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:51:18.570419 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-9ffc43d6-5f38-4c26-9f50-b2563ac1fba5 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:51:18.571135 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-9ffc43d6-5f38-4c26-9f50-b2563ac1fba5 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:51:18.580655 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-9ffc43d6-5f38-4c26-9f50-b2563ac1fba5 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:51:18.583091 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-9ffc43d6-5f38-4c26-9f50-b2563ac1fba5 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:51:18.666754 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.wsgi [None req-9ffc43d6-5f38-4c26-9f50-b2563ac1fba5 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] HTTP exception thrown: Instance 91615e87-1e43-4d69-baab-d7af897d1ac3 could not be found. Dec 24 10:51:18.667626 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-9ffc43d6-5f38-4c26-9f50-b2563ac1fba5 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Returning 404 to user: Instance 91615e87-1e43-4d69-baab-d7af897d1ac3 could not be found. {{(pid=123431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 24 10:51:18.668650 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-9ffc43d6-5f38-4c26-9f50-b2563ac1fba5 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] 10.222.0.30 "GET /compute/v2.1/servers/91615e87-1e43-4d69-baab-d7af897d1ac3" status: 404 len: 111 microversion: 2.1 time: 0.132446 Dec 24 10:51:18.690322 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 504/1007] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:51:18 2021] GET /compute/v2.1/servers/91615e87-1e43-4d69-baab-d7af897d1ac3 => generated 111 bytes in 154 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 24 10:51:18.758120 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-eac5bdd6-da4b-434d-b518-a35ab7645623 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:51:18.765611 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-eac5bdd6-da4b-434d-b518-a35ab7645623 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] [instance: 1e267da4-1e48-4136-babc-656ccd50aae2] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:51:18.775653 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-eac5bdd6-da4b-434d-b518-a35ab7645623 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:51:18.776360 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-eac5bdd6-da4b-434d-b518-a35ab7645623 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:51:18.777360 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-eac5bdd6-da4b-434d-b518-a35ab7645623 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:51:18.777977 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-eac5bdd6-da4b-434d-b518-a35ab7645623 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:51:18.895975 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-58020c32-00bb-46b3-9cfa-3df96066c3cb tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-934895983", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-2082088977", "security_groups": [{"name": "tempest-secgroup-smoke-1649720889"}], "block_device_mapping_v2": [{"uuid": "63633061-170a-4ba6-9ad5-20ec39522c20", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "c02b29c7-4d73-429c-95e6-0bbcaa5e122f"}]}} {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:51:19.138313 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.network.neutron [None req-58020c32-00bb-46b3-9cfa-3df96066c3cb tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] validate_networks() for [('c02b29c7-4d73-429c-95e6-0bbcaa5e122f', None, None, None, None, None)] {{(pid=123431) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 24 10:51:20.045720 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.virt.hardware [None req-58020c32-00bb-46b3-9cfa-3df96066c3cb tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Flavor limits 0:0:0 {{(pid=123431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 24 10:51:20.047129 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.virt.hardware [None req-58020c32-00bb-46b3-9cfa-3df96066c3cb tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Image limits 0:0:0 {{(pid=123431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 24 10:51:20.047950 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.virt.hardware [None req-58020c32-00bb-46b3-9cfa-3df96066c3cb tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Flavor pref 0:0:0 {{(pid=123431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 24 10:51:20.048679 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.virt.hardware [None req-58020c32-00bb-46b3-9cfa-3df96066c3cb tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Image pref 0:0:0 {{(pid=123431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 24 10:51:20.049403 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.virt.hardware [None req-58020c32-00bb-46b3-9cfa-3df96066c3cb tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 24 10:51:20.063463 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-58020c32-00bb-46b3-9cfa-3df96066c3cb tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:51:20.064277 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-58020c32-00bb-46b3-9cfa-3df96066c3cb tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:51:20.065351 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-58020c32-00bb-46b3-9cfa-3df96066c3cb tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:51:20.065865 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-58020c32-00bb-46b3-9cfa-3df96066c3cb tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:51:20.086348 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.quota [None req-58020c32-00bb-46b3-9cfa-3df96066c3cb tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Getting quotas for project 9d0fd34670674906aa9a61200251b76c. Resources: {'instances', 'cores', 'ram'} {{(pid=123431) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 24 10:51:20.091453 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.quota [None req-58020c32-00bb-46b3-9cfa-3df96066c3cb tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Getting quotas for user b690a952a1704197baf5e653e27160f2 and project 9d0fd34670674906aa9a61200251b76c. Resources: {'instances', 'cores', 'ram'} {{(pid=123431) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 24 10:51:20.166550 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-58020c32-00bb-46b3-9cfa-3df96066c3cb tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Going to run 1 instances... {{(pid=123431) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 24 10:51:20.169340 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-58020c32-00bb-46b3-9cfa-3df96066c3cb tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] [instance: 6d8fff5e-934d-469e-8a9b-8457f3a062cf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='63633061-170a-4ba6-9ad5-20ec39522c20',volume_size=None,volume_type=None)] {{(pid=123431) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 24 10:51:20.737293 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-58020c32-00bb-46b3-9cfa-3df96066c3cb tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.844842 Dec 24 10:51:20.743322 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 505/1008] 10.222.0.30 () {60 vars in 1146 bytes} [Fri Dec 24 10:51:18 2021] POST /compute/v2.1/servers => generated 406 bytes in 1854 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 24 10:51:20.752192 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-8f36a835-7512-4c82-a517-20e263e720f5 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:51:20.752578 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-8f36a835-7512-4c82-a517-20e263e720f5 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] [instance: d2c0f276-f763-4337-a5dd-0c328c8c2e73] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:51:20.779386 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-8f36a835-7512-4c82-a517-20e263e720f5 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:51:20.780128 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-8f36a835-7512-4c82-a517-20e263e720f5 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:51:20.781944 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-8f36a835-7512-4c82-a517-20e263e720f5 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:51:20.782760 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-8f36a835-7512-4c82-a517-20e263e720f5 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:51:20.974267 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-8f36a835-7512-4c82-a517-20e263e720f5 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:51:20.983375 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-8f36a835-7512-4c82-a517-20e263e720f5 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:51:20.985727 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-8f36a835-7512-4c82-a517-20e263e720f5 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:51:20.987113 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-8f36a835-7512-4c82-a517-20e263e720f5 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] 10.222.0.30 "GET /compute/v2.1/servers/d2c0f276-f763-4337-a5dd-0c328c8c2e73" status: 200 len: 1739 microversion: 2.20 time: 0.240027 Dec 24 10:51:20.987908 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 506/1009] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Dec 24 10:51:20 2021] GET /compute/v2.1/servers/d2c0f276-f763-4337-a5dd-0c328c8c2e73 => generated 1739 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 10:51:20.992751 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-8de77b62-46ab-48d0-b09f-6c3f322c0bf0 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:51:20.993377 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-8de77b62-46ab-48d0-b09f-6c3f322c0bf0 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] [instance: 6d8fff5e-934d-469e-8a9b-8457f3a062cf] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:51:21.055225 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-8de77b62-46ab-48d0-b09f-6c3f322c0bf0 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b690a952a1704197baf5e653e27160f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0fd34670674906aa9a61200251b76c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:51:21.062709 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-8de77b62-46ab-48d0-b09f-6c3f322c0bf0 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] 10.222.0.30 "GET /compute/v2.1/servers/6d8fff5e-934d-469e-8a9b-8457f3a062cf" status: 200 len: 1094 microversion: 2.1 time: 0.073362 Dec 24 10:51:21.063357 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 507/1010] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:51:20 2021] GET /compute/v2.1/servers/6d8fff5e-934d-469e-8a9b-8457f3a062cf => generated 1094 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:51:21.212867 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-eac5bdd6-da4b-434d-b518-a35ab7645623 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] 10.222.0.30 "POST /compute/v2.1/servers/1e267da4-1e48-4136-babc-656ccd50aae2/action" status: 200 len: 22804 microversion: 2.1 time: 2.458352 Dec 24 10:51:21.216916 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 504/1011] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Dec 24 10:51:18 2021] POST /compute/v2.1/servers/1e267da4-1e48-4136-babc-656ccd50aae2/action => generated 22804 bytes in 2460 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 24 10:51:22.005776 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-57731e06-1030-4848-9b6f-00c6701e5423 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:51:22.006760 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-57731e06-1030-4848-9b6f-00c6701e5423 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] [instance: d2c0f276-f763-4337-a5dd-0c328c8c2e73] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:51:22.017517 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-57731e06-1030-4848-9b6f-00c6701e5423 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:51:22.021513 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-57731e06-1030-4848-9b6f-00c6701e5423 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:51:22.022588 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-57731e06-1030-4848-9b6f-00c6701e5423 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:51:22.023403 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-57731e06-1030-4848-9b6f-00c6701e5423 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:51:22.080383 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-57c9cba6-1bfa-4886-8a2a-326c5b7f90bd tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:51:22.081414 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-57c9cba6-1bfa-4886-8a2a-326c5b7f90bd tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] [instance: 6d8fff5e-934d-469e-8a9b-8457f3a062cf] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:51:22.111174 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-57c9cba6-1bfa-4886-8a2a-326c5b7f90bd tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:51:22.117989 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-57c9cba6-1bfa-4886-8a2a-326c5b7f90bd tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:51:22.121440 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-57c9cba6-1bfa-4886-8a2a-326c5b7f90bd tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:51:22.121440 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-57c9cba6-1bfa-4886-8a2a-326c5b7f90bd tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:51:22.346416 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-57c9cba6-1bfa-4886-8a2a-326c5b7f90bd tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b690a952a1704197baf5e653e27160f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0fd34670674906aa9a61200251b76c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:51:22.356014 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-57c9cba6-1bfa-4886-8a2a-326c5b7f90bd tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] 10.222.0.30 "GET /compute/v2.1/servers/6d8fff5e-934d-469e-8a9b-8457f3a062cf" status: 200 len: 1144 microversion: 2.1 time: 0.279818 Dec 24 10:51:22.356587 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 505/1012] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:51:22 2021] GET /compute/v2.1/servers/6d8fff5e-934d-469e-8a9b-8457f3a062cf => generated 1144 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:51:22.378497 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-fc410e14-29df-4e32-b214-cd7cad34d49f tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:51:22.381316 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-fc410e14-29df-4e32-b214-cd7cad34d49f tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] [instance: 1e267da4-1e48-4136-babc-656ccd50aae2] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:51:22.395916 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-fc410e14-29df-4e32-b214-cd7cad34d49f tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:51:22.396369 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-fc410e14-29df-4e32-b214-cd7cad34d49f tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:51:22.397219 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-fc410e14-29df-4e32-b214-cd7cad34d49f tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:51:22.404048 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-57731e06-1030-4848-9b6f-00c6701e5423 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:51:22.417321 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-57731e06-1030-4848-9b6f-00c6701e5423 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:51:22.428473 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-57731e06-1030-4848-9b6f-00c6701e5423 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:51:22.433168 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-57731e06-1030-4848-9b6f-00c6701e5423 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] 10.222.0.30 "GET /compute/v2.1/servers/d2c0f276-f763-4337-a5dd-0c328c8c2e73" status: 200 len: 1739 microversion: 2.20 time: 0.425703 Dec 24 10:51:22.441554 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 508/1013] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Dec 24 10:51:22 2021] GET /compute/v2.1/servers/d2c0f276-f763-4337-a5dd-0c328c8c2e73 => generated 1739 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 24 10:51:22.455520 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-fc410e14-29df-4e32-b214-cd7cad34d49f tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:51:22.566391 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-fc410e14-29df-4e32-b214-cd7cad34d49f tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] 10.222.0.30 "POST /compute/v2.1/servers/1e267da4-1e48-4136-babc-656ccd50aae2/action" status: 200 len: 23804 microversion: 2.1 time: 0.195593 Dec 24 10:51:22.567855 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 506/1014] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Dec 24 10:51:22 2021] POST /compute/v2.1/servers/1e267da4-1e48-4136-babc-656ccd50aae2/action => generated 23804 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 24 10:51:23.433294 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-04a56c40-e439-40cb-87d1-6ffb02f6ebb5 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:51:23.433294 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-04a56c40-e439-40cb-87d1-6ffb02f6ebb5 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] [instance: 6d8fff5e-934d-469e-8a9b-8457f3a062cf] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:51:23.453043 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-04a56c40-e439-40cb-87d1-6ffb02f6ebb5 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:51:23.460736 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-5f5adf31-c0bf-446a-a81a-feeee07cacfb tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:51:23.462523 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-5f5adf31-c0bf-446a-a81a-feeee07cacfb tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] [instance: d2c0f276-f763-4337-a5dd-0c328c8c2e73] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:51:23.469530 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-04a56c40-e439-40cb-87d1-6ffb02f6ebb5 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:51:23.470389 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-04a56c40-e439-40cb-87d1-6ffb02f6ebb5 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:51:23.470828 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-04a56c40-e439-40cb-87d1-6ffb02f6ebb5 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:51:23.474704 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-5f5adf31-c0bf-446a-a81a-feeee07cacfb tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:51:23.475634 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-5f5adf31-c0bf-446a-a81a-feeee07cacfb tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:51:23.476739 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-5f5adf31-c0bf-446a-a81a-feeee07cacfb tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:51:23.477463 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-5f5adf31-c0bf-446a-a81a-feeee07cacfb tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:51:23.663382 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-04a56c40-e439-40cb-87d1-6ffb02f6ebb5 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b690a952a1704197baf5e653e27160f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0fd34670674906aa9a61200251b76c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:51:23.679891 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-5f5adf31-c0bf-446a-a81a-feeee07cacfb tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:51:23.681175 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-04a56c40-e439-40cb-87d1-6ffb02f6ebb5 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] 10.222.0.30 "GET /compute/v2.1/servers/6d8fff5e-934d-469e-8a9b-8457f3a062cf" status: 200 len: 1192 microversion: 2.1 time: 0.308654 Dec 24 10:51:23.681771 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 509/1015] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:51:23 2021] GET /compute/v2.1/servers/6d8fff5e-934d-469e-8a9b-8457f3a062cf => generated 1192 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:51:23.686320 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-5f70876a-9fce-4df8-abc6-649202ad7cae tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:51:23.687264 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-5f70876a-9fce-4df8-abc6-649202ad7cae tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] [instance: 1e267da4-1e48-4136-babc-656ccd50aae2] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:51:23.692314 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-5f5adf31-c0bf-446a-a81a-feeee07cacfb tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:51:23.694092 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-5f70876a-9fce-4df8-abc6-649202ad7cae tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:51:23.694543 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-5f5adf31-c0bf-446a-a81a-feeee07cacfb tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:51:23.694673 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-5f70876a-9fce-4df8-abc6-649202ad7cae tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:51:23.695520 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-5f70876a-9fce-4df8-abc6-649202ad7cae tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:51:23.695992 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-5f70876a-9fce-4df8-abc6-649202ad7cae tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:51:23.696540 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-5f5adf31-c0bf-446a-a81a-feeee07cacfb tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] 10.222.0.30 "GET /compute/v2.1/servers/d2c0f276-f763-4337-a5dd-0c328c8c2e73" status: 200 len: 1739 microversion: 2.20 time: 0.240685 Dec 24 10:51:23.712984 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 507/1016] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Dec 24 10:51:23 2021] GET /compute/v2.1/servers/d2c0f276-f763-4337-a5dd-0c328c8c2e73 => generated 1739 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 10:51:24.701938 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-709d066e-dc2c-4bbe-84f3-4c0644fea69a tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:51:24.704371 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-709d066e-dc2c-4bbe-84f3-4c0644fea69a tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] [instance: 6d8fff5e-934d-469e-8a9b-8457f3a062cf] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:51:24.714794 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-709d066e-dc2c-4bbe-84f3-4c0644fea69a tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:51:24.715251 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-709d066e-dc2c-4bbe-84f3-4c0644fea69a tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:51:24.716055 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-709d066e-dc2c-4bbe-84f3-4c0644fea69a tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:51:24.716492 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-709d066e-dc2c-4bbe-84f3-4c0644fea69a tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:51:24.791322 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-709d066e-dc2c-4bbe-84f3-4c0644fea69a tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b690a952a1704197baf5e653e27160f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0fd34670674906aa9a61200251b76c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:51:24.800895 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-709d066e-dc2c-4bbe-84f3-4c0644fea69a tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] 10.222.0.30 "GET /compute/v2.1/servers/6d8fff5e-934d-469e-8a9b-8457f3a062cf" status: 200 len: 1192 microversion: 2.1 time: 0.101925 Dec 24 10:51:24.801735 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 508/1017] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:51:24 2021] GET /compute/v2.1/servers/6d8fff5e-934d-469e-8a9b-8457f3a062cf => generated 1192 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 24 10:51:24.820291 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-e35ca024-08b5-4501-82e2-46635bc83d19 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:51:24.820925 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-e35ca024-08b5-4501-82e2-46635bc83d19 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] [instance: d2c0f276-f763-4337-a5dd-0c328c8c2e73] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:51:24.827058 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-e35ca024-08b5-4501-82e2-46635bc83d19 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:51:24.827514 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-e35ca024-08b5-4501-82e2-46635bc83d19 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:51:24.828303 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-e35ca024-08b5-4501-82e2-46635bc83d19 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:51:24.828743 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-e35ca024-08b5-4501-82e2-46635bc83d19 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:51:25.036165 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-e35ca024-08b5-4501-82e2-46635bc83d19 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:51:25.052842 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-e35ca024-08b5-4501-82e2-46635bc83d19 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:51:25.057086 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-e35ca024-08b5-4501-82e2-46635bc83d19 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:51:25.060135 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-e35ca024-08b5-4501-82e2-46635bc83d19 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] 10.222.0.30 "GET /compute/v2.1/servers/d2c0f276-f763-4337-a5dd-0c328c8c2e73" status: 200 len: 1739 microversion: 2.20 time: 0.242630 Dec 24 10:51:25.061830 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 509/1018] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Dec 24 10:51:24 2021] GET /compute/v2.1/servers/d2c0f276-f763-4337-a5dd-0c328c8c2e73 => generated 1739 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 10:51:25.826541 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-0ddf5fc2-0ca4-4af3-86ca-6044eb67d77d tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:51:25.827371 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-0ddf5fc2-0ca4-4af3-86ca-6044eb67d77d tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] [instance: 6d8fff5e-934d-469e-8a9b-8457f3a062cf] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:51:25.851447 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-0ddf5fc2-0ca4-4af3-86ca-6044eb67d77d tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:51:25.852216 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-0ddf5fc2-0ca4-4af3-86ca-6044eb67d77d tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:51:25.854319 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-0ddf5fc2-0ca4-4af3-86ca-6044eb67d77d tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:51:25.865704 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-0ddf5fc2-0ca4-4af3-86ca-6044eb67d77d tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:51:25.988093 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-0ddf5fc2-0ca4-4af3-86ca-6044eb67d77d tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b690a952a1704197baf5e653e27160f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0fd34670674906aa9a61200251b76c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:51:25.999442 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-0ddf5fc2-0ca4-4af3-86ca-6044eb67d77d tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] 10.222.0.30 "GET /compute/v2.1/servers/6d8fff5e-934d-469e-8a9b-8457f3a062cf" status: 200 len: 1192 microversion: 2.1 time: 0.177710 Dec 24 10:51:26.010606 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 510/1019] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:51:25 2021] GET /compute/v2.1/servers/6d8fff5e-934d-469e-8a9b-8457f3a062cf => generated 1192 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:51:26.025767 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-5f70876a-9fce-4df8-abc6-649202ad7cae tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] 10.222.0.30 "POST /compute/v2.1/servers/1e267da4-1e48-4136-babc-656ccd50aae2/action" status: 200 len: 26965 microversion: 2.1 time: 2.342114 Dec 24 10:51:26.026601 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 510/1020] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Dec 24 10:51:23 2021] POST /compute/v2.1/servers/1e267da4-1e48-4136-babc-656ccd50aae2/action => generated 26965 bytes in 2344 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 24 10:51:26.079639 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-37254037-49f5-4105-a5d6-9882dd5b2dc1 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:51:26.080786 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-37254037-49f5-4105-a5d6-9882dd5b2dc1 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] [instance: d2c0f276-f763-4337-a5dd-0c328c8c2e73] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:51:26.092651 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-37254037-49f5-4105-a5d6-9882dd5b2dc1 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:51:26.097080 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-37254037-49f5-4105-a5d6-9882dd5b2dc1 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:51:26.098313 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-37254037-49f5-4105-a5d6-9882dd5b2dc1 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:51:26.098876 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-37254037-49f5-4105-a5d6-9882dd5b2dc1 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:51:26.280868 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-37254037-49f5-4105-a5d6-9882dd5b2dc1 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:51:26.290995 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-37254037-49f5-4105-a5d6-9882dd5b2dc1 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:51:26.292745 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-37254037-49f5-4105-a5d6-9882dd5b2dc1 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:51:26.294182 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-37254037-49f5-4105-a5d6-9882dd5b2dc1 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] 10.222.0.30 "GET /compute/v2.1/servers/d2c0f276-f763-4337-a5dd-0c328c8c2e73" status: 200 len: 1739 microversion: 2.20 time: 0.218610 Dec 24 10:51:26.296864 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 511/1021] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Dec 24 10:51:26 2021] GET /compute/v2.1/servers/d2c0f276-f763-4337-a5dd-0c328c8c2e73 => generated 1739 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 10:51:27.021968 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-ee4e8a19-34ee-4902-a50d-e01c9e7a3aea tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:51:27.022834 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-ee4e8a19-34ee-4902-a50d-e01c9e7a3aea tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] [instance: 6d8fff5e-934d-469e-8a9b-8457f3a062cf] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:51:27.046293 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-ee4e8a19-34ee-4902-a50d-e01c9e7a3aea tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:51:27.046293 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-ee4e8a19-34ee-4902-a50d-e01c9e7a3aea tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:51:27.046945 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-ee4e8a19-34ee-4902-a50d-e01c9e7a3aea tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:51:27.047069 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-ee4e8a19-34ee-4902-a50d-e01c9e7a3aea tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:51:27.111505 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-8f26601f-d80b-4772-8e3e-de06cab2084e tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:51:27.112560 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-8f26601f-d80b-4772-8e3e-de06cab2084e tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] [instance: 1e267da4-1e48-4136-babc-656ccd50aae2] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:51:27.130130 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-8f26601f-d80b-4772-8e3e-de06cab2084e tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:51:27.132763 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-8f26601f-d80b-4772-8e3e-de06cab2084e tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:51:27.137777 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-8f26601f-d80b-4772-8e3e-de06cab2084e tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:51:27.139209 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-8f26601f-d80b-4772-8e3e-de06cab2084e tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:51:27.249385 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-8f26601f-d80b-4772-8e3e-de06cab2084e tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] 10.222.0.30 "POST /compute/v2.1/servers/1e267da4-1e48-4136-babc-656ccd50aae2/action" status: 200 len: 27532 microversion: 2.1 time: 0.214127 Dec 24 10:51:27.254091 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 512/1022] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Dec 24 10:51:27 2021] POST /compute/v2.1/servers/1e267da4-1e48-4136-babc-656ccd50aae2/action => generated 27532 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 24 10:51:27.299446 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-ee4e8a19-34ee-4902-a50d-e01c9e7a3aea tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b690a952a1704197baf5e653e27160f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0fd34670674906aa9a61200251b76c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:51:27.312505 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-ee4e8a19-34ee-4902-a50d-e01c9e7a3aea tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] 10.222.0.30 "GET /compute/v2.1/servers/6d8fff5e-934d-469e-8a9b-8457f3a062cf" status: 200 len: 1200 microversion: 2.1 time: 0.297192 Dec 24 10:51:27.313335 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-e8634454-d397-4cdb-8b59-d9601eb0a3f3 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:51:27.314220 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 511/1023] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:51:27 2021] GET /compute/v2.1/servers/6d8fff5e-934d-469e-8a9b-8457f3a062cf => generated 1200 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:51:27.323830 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-e8634454-d397-4cdb-8b59-d9601eb0a3f3 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] [instance: d2c0f276-f763-4337-a5dd-0c328c8c2e73] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:51:27.369082 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-e8634454-d397-4cdb-8b59-d9601eb0a3f3 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:51:27.369082 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-e8634454-d397-4cdb-8b59-d9601eb0a3f3 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:51:27.369082 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-e8634454-d397-4cdb-8b59-d9601eb0a3f3 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:51:27.369082 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-e8634454-d397-4cdb-8b59-d9601eb0a3f3 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:51:27.571777 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-e8634454-d397-4cdb-8b59-d9601eb0a3f3 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:51:27.580709 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-e8634454-d397-4cdb-8b59-d9601eb0a3f3 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:51:27.582719 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-e8634454-d397-4cdb-8b59-d9601eb0a3f3 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:51:27.583892 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-e8634454-d397-4cdb-8b59-d9601eb0a3f3 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] 10.222.0.30 "GET /compute/v2.1/servers/d2c0f276-f763-4337-a5dd-0c328c8c2e73" status: 200 len: 1739 microversion: 2.20 time: 0.275898 Dec 24 10:51:27.595555 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 513/1024] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Dec 24 10:51:27 2021] GET /compute/v2.1/servers/d2c0f276-f763-4337-a5dd-0c328c8c2e73 => generated 1739 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 10:51:28.275613 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-cd88b46e-98d6-46c5-a2fc-0563aa6e20ae tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:51:28.276553 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-cd88b46e-98d6-46c5-a2fc-0563aa6e20ae tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] [instance: 1e267da4-1e48-4136-babc-656ccd50aae2] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:51:28.291100 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-cd88b46e-98d6-46c5-a2fc-0563aa6e20ae tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:51:28.291562 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-cd88b46e-98d6-46c5-a2fc-0563aa6e20ae tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:51:28.292358 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-cd88b46e-98d6-46c5-a2fc-0563aa6e20ae tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:51:28.293003 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-cd88b46e-98d6-46c5-a2fc-0563aa6e20ae tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:51:28.330379 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-865dc0cb-bd46-4f49-a3e4-801395d88462 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:51:28.331094 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-865dc0cb-bd46-4f49-a3e4-801395d88462 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] [instance: 6d8fff5e-934d-469e-8a9b-8457f3a062cf] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:51:28.337719 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-865dc0cb-bd46-4f49-a3e4-801395d88462 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:51:28.338103 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-865dc0cb-bd46-4f49-a3e4-801395d88462 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:51:28.339130 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-865dc0cb-bd46-4f49-a3e4-801395d88462 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:51:28.339726 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-865dc0cb-bd46-4f49-a3e4-801395d88462 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:51:28.379125 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-cd88b46e-98d6-46c5-a2fc-0563aa6e20ae tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] 10.222.0.30 "POST /compute/v2.1/servers/1e267da4-1e48-4136-babc-656ccd50aae2/action" status: 200 len: 27868 microversion: 2.1 time: 0.115554 Dec 24 10:51:28.380257 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 512/1025] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Dec 24 10:51:28 2021] POST /compute/v2.1/servers/1e267da4-1e48-4136-babc-656ccd50aae2/action => generated 27868 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 24 10:51:28.409679 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-865dc0cb-bd46-4f49-a3e4-801395d88462 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b690a952a1704197baf5e653e27160f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0fd34670674906aa9a61200251b76c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:51:28.418419 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-865dc0cb-bd46-4f49-a3e4-801395d88462 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] 10.222.0.30 "GET /compute/v2.1/servers/6d8fff5e-934d-469e-8a9b-8457f3a062cf" status: 200 len: 1210 microversion: 2.1 time: 0.091599 Dec 24 10:51:28.428268 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 514/1026] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:51:28 2021] GET /compute/v2.1/servers/6d8fff5e-934d-469e-8a9b-8457f3a062cf => generated 1210 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 24 10:51:28.604990 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-f49e5f4b-066b-4dcc-89c0-80b96fc626d9 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:51:28.606096 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-f49e5f4b-066b-4dcc-89c0-80b96fc626d9 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] [instance: d2c0f276-f763-4337-a5dd-0c328c8c2e73] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:51:28.625482 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-f49e5f4b-066b-4dcc-89c0-80b96fc626d9 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:51:28.626366 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-f49e5f4b-066b-4dcc-89c0-80b96fc626d9 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:51:28.629773 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-f49e5f4b-066b-4dcc-89c0-80b96fc626d9 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:51:28.629773 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-f49e5f4b-066b-4dcc-89c0-80b96fc626d9 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:51:28.999871 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-f49e5f4b-066b-4dcc-89c0-80b96fc626d9 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:51:29.011275 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-f49e5f4b-066b-4dcc-89c0-80b96fc626d9 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:51:29.013676 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-f49e5f4b-066b-4dcc-89c0-80b96fc626d9 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:51:29.015708 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-f49e5f4b-066b-4dcc-89c0-80b96fc626d9 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] 10.222.0.30 "GET /compute/v2.1/servers/d2c0f276-f763-4337-a5dd-0c328c8c2e73" status: 200 len: 1739 microversion: 2.20 time: 0.417486 Dec 24 10:51:29.016984 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 513/1027] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Dec 24 10:51:28 2021] GET /compute/v2.1/servers/d2c0f276-f763-4337-a5dd-0c328c8c2e73 => generated 1739 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 10:51:29.393686 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-28ed6d60-7905-4155-b264-a2d4af7fcf80 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:51:29.396205 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-28ed6d60-7905-4155-b264-a2d4af7fcf80 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] [instance: 1e267da4-1e48-4136-babc-656ccd50aae2] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:51:29.406155 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-28ed6d60-7905-4155-b264-a2d4af7fcf80 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:51:29.407317 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-28ed6d60-7905-4155-b264-a2d4af7fcf80 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:51:29.408322 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-28ed6d60-7905-4155-b264-a2d4af7fcf80 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:51:29.408757 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-28ed6d60-7905-4155-b264-a2d4af7fcf80 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:51:29.438400 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-f14d0909-fd1c-48ba-98da-f1dfe7b0c48c tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:51:29.439011 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-f14d0909-fd1c-48ba-98da-f1dfe7b0c48c tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] [instance: 6d8fff5e-934d-469e-8a9b-8457f3a062cf] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:51:29.448576 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-f14d0909-fd1c-48ba-98da-f1dfe7b0c48c tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:51:29.450358 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-f14d0909-fd1c-48ba-98da-f1dfe7b0c48c tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:51:29.451326 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-f14d0909-fd1c-48ba-98da-f1dfe7b0c48c tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:51:29.451953 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-f14d0909-fd1c-48ba-98da-f1dfe7b0c48c tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:51:29.682779 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-f14d0909-fd1c-48ba-98da-f1dfe7b0c48c tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b690a952a1704197baf5e653e27160f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0fd34670674906aa9a61200251b76c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:51:29.693748 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-f14d0909-fd1c-48ba-98da-f1dfe7b0c48c tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] 10.222.0.30 "GET /compute/v2.1/servers/6d8fff5e-934d-469e-8a9b-8457f3a062cf" status: 200 len: 1278 microversion: 2.1 time: 0.259282 Dec 24 10:51:29.694705 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 514/1028] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:51:29 2021] GET /compute/v2.1/servers/6d8fff5e-934d-469e-8a9b-8457f3a062cf => generated 1278 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 24 10:51:29.983330 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [req-e6ae4286-b822-439d-ac7d-2e3a16162e81 req-6cd1eb8d-d69d-413f-9638-ff9d73952070 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6d8fff5e-934d-469e-8a9b-8457f3a062cf", "tag": "1d65157c-7f7f-44f7-86a3-f01fae63875b"}]} {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:51:29.984895 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 10:51:29.984895 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: warnings.warn(msg) Dec 24 10:51:29.997669 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [req-e6ae4286-b822-439d-ac7d-2e3a16162e81 req-6cd1eb8d-d69d-413f-9638-ff9d73952070 service nova] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:51:29.998320 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [req-e6ae4286-b822-439d-ac7d-2e3a16162e81 req-6cd1eb8d-d69d-413f-9638-ff9d73952070 service nova] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:51:30.018261 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.compute.server_external_events [req-e6ae4286-b822-439d-ac7d-2e3a16162e81 req-6cd1eb8d-d69d-413f-9638-ff9d73952070 service nova] Creating event network-changed:1d65157c-7f7f-44f7-86a3-f01fae63875b for instance 6d8fff5e-934d-469e-8a9b-8457f3a062cf on hv-cinder-81644 Dec 24 10:51:30.025503 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [req-e6ae4286-b822-439d-ac7d-2e3a16162e81 req-6cd1eb8d-d69d-413f-9638-ff9d73952070 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046739 Dec 24 10:51:30.026707 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 515/1029] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Dec 24 10:51:29 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 24 10:51:30.040095 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-5ead983c-fb98-4124-b863-a582e4c53271 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:51:30.041261 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-5ead983c-fb98-4124-b863-a582e4c53271 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] [instance: d2c0f276-f763-4337-a5dd-0c328c8c2e73] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:51:30.048798 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-5ead983c-fb98-4124-b863-a582e4c53271 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:51:30.049547 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-5ead983c-fb98-4124-b863-a582e4c53271 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:51:30.050589 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-5ead983c-fb98-4124-b863-a582e4c53271 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:51:30.051471 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-5ead983c-fb98-4124-b863-a582e4c53271 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:51:30.230873 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-5ead983c-fb98-4124-b863-a582e4c53271 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:51:30.248081 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-5ead983c-fb98-4124-b863-a582e4c53271 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:51:30.257050 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-5ead983c-fb98-4124-b863-a582e4c53271 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:51:30.259746 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-5ead983c-fb98-4124-b863-a582e4c53271 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] 10.222.0.30 "GET /compute/v2.1/servers/d2c0f276-f763-4337-a5dd-0c328c8c2e73" status: 200 len: 1739 microversion: 2.20 time: 0.223807 Dec 24 10:51:30.260434 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 516/1030] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Dec 24 10:51:30 2021] GET /compute/v2.1/servers/d2c0f276-f763-4337-a5dd-0c328c8c2e73 => generated 1739 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 10:51:30.711615 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-3f6c3ef7-9fd7-406b-a951-9720defd3b81 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:51:30.712798 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-3f6c3ef7-9fd7-406b-a951-9720defd3b81 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] [instance: 6d8fff5e-934d-469e-8a9b-8457f3a062cf] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:51:30.722137 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-3f6c3ef7-9fd7-406b-a951-9720defd3b81 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:51:30.722611 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-3f6c3ef7-9fd7-406b-a951-9720defd3b81 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:51:30.723420 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-3f6c3ef7-9fd7-406b-a951-9720defd3b81 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:51:30.724100 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-3f6c3ef7-9fd7-406b-a951-9720defd3b81 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:51:30.876124 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-3f6c3ef7-9fd7-406b-a951-9720defd3b81 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b690a952a1704197baf5e653e27160f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0fd34670674906aa9a61200251b76c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:51:30.885392 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-3f6c3ef7-9fd7-406b-a951-9720defd3b81 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] 10.222.0.30 "GET /compute/v2.1/servers/6d8fff5e-934d-469e-8a9b-8457f3a062cf" status: 200 len: 1278 microversion: 2.1 time: 0.177472 Dec 24 10:51:30.886133 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 517/1031] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:51:30 2021] GET /compute/v2.1/servers/6d8fff5e-934d-469e-8a9b-8457f3a062cf => generated 1278 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 24 10:51:31.280177 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-1f5209fe-c317-47fe-9bf7-098be51940cf tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:51:31.280785 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-1f5209fe-c317-47fe-9bf7-098be51940cf tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] [instance: d2c0f276-f763-4337-a5dd-0c328c8c2e73] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:51:31.295758 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-1f5209fe-c317-47fe-9bf7-098be51940cf tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:51:31.296224 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-1f5209fe-c317-47fe-9bf7-098be51940cf tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:51:31.298377 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-1f5209fe-c317-47fe-9bf7-098be51940cf tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:51:31.298824 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-1f5209fe-c317-47fe-9bf7-098be51940cf tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:51:31.459370 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-1f5209fe-c317-47fe-9bf7-098be51940cf tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:51:31.469600 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-1f5209fe-c317-47fe-9bf7-098be51940cf tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:51:31.471750 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-1f5209fe-c317-47fe-9bf7-098be51940cf tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:51:31.472974 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-1f5209fe-c317-47fe-9bf7-098be51940cf tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] 10.222.0.30 "GET /compute/v2.1/servers/d2c0f276-f763-4337-a5dd-0c328c8c2e73" status: 200 len: 1739 microversion: 2.20 time: 0.196796 Dec 24 10:51:31.473536 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 518/1032] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Dec 24 10:51:31 2021] GET /compute/v2.1/servers/d2c0f276-f763-4337-a5dd-0c328c8c2e73 => generated 1739 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 24 10:51:31.895405 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-28ed6d60-7905-4155-b264-a2d4af7fcf80 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] 10.222.0.30 "POST /compute/v2.1/servers/1e267da4-1e48-4136-babc-656ccd50aae2/action" status: 200 len: 28180 microversion: 2.1 time: 2.507410 Dec 24 10:51:31.896298 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 515/1033] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Dec 24 10:51:29 2021] POST /compute/v2.1/servers/1e267da4-1e48-4136-babc-656ccd50aae2/action => generated 28180 bytes in 2509 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 24 10:51:31.903928 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-585e935d-f3fa-4d36-9196-8fee4345fc01 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:51:31.904546 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-585e935d-f3fa-4d36-9196-8fee4345fc01 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] [instance: 6d8fff5e-934d-469e-8a9b-8457f3a062cf] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:51:31.911153 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-585e935d-f3fa-4d36-9196-8fee4345fc01 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:51:31.911603 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-585e935d-f3fa-4d36-9196-8fee4345fc01 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:51:31.912408 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-585e935d-f3fa-4d36-9196-8fee4345fc01 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:51:31.912959 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-585e935d-f3fa-4d36-9196-8fee4345fc01 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:51:32.138228 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-585e935d-f3fa-4d36-9196-8fee4345fc01 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b690a952a1704197baf5e653e27160f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0fd34670674906aa9a61200251b76c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:51:32.145853 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-585e935d-f3fa-4d36-9196-8fee4345fc01 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] 10.222.0.30 "GET /compute/v2.1/servers/6d8fff5e-934d-469e-8a9b-8457f3a062cf" status: 200 len: 1278 microversion: 2.1 time: 0.246124 Dec 24 10:51:32.146427 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 519/1034] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:51:31 2021] GET /compute/v2.1/servers/6d8fff5e-934d-469e-8a9b-8457f3a062cf => generated 1278 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:51:32.492694 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-edae3adb-c341-4784-b5ae-dd11fadd1c23 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:51:32.494573 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-edae3adb-c341-4784-b5ae-dd11fadd1c23 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] [instance: d2c0f276-f763-4337-a5dd-0c328c8c2e73] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:51:32.502517 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-edae3adb-c341-4784-b5ae-dd11fadd1c23 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:51:32.503232 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-edae3adb-c341-4784-b5ae-dd11fadd1c23 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:51:32.504050 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-edae3adb-c341-4784-b5ae-dd11fadd1c23 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:51:32.504650 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-edae3adb-c341-4784-b5ae-dd11fadd1c23 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:51:32.710712 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-edae3adb-c341-4784-b5ae-dd11fadd1c23 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:51:32.720596 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-edae3adb-c341-4784-b5ae-dd11fadd1c23 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:51:32.727493 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-edae3adb-c341-4784-b5ae-dd11fadd1c23 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:51:32.729426 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-edae3adb-c341-4784-b5ae-dd11fadd1c23 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] 10.222.0.30 "GET /compute/v2.1/servers/d2c0f276-f763-4337-a5dd-0c328c8c2e73" status: 200 len: 1721 microversion: 2.20 time: 0.241219 Dec 24 10:51:32.731038 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 516/1035] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Dec 24 10:51:32 2021] GET /compute/v2.1/servers/d2c0f276-f763-4337-a5dd-0c328c8c2e73 => generated 1721 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 10:51:32.909434 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-88476495-399b-4870-a5d3-436c2f206ac7 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:51:32.911162 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-88476495-399b-4870-a5d3-436c2f206ac7 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] [instance: 1e267da4-1e48-4136-babc-656ccd50aae2] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:51:32.918643 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-88476495-399b-4870-a5d3-436c2f206ac7 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:51:32.919570 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-88476495-399b-4870-a5d3-436c2f206ac7 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:51:32.920693 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-88476495-399b-4870-a5d3-436c2f206ac7 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:51:32.921151 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-88476495-399b-4870-a5d3-436c2f206ac7 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:51:32.994439 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-88476495-399b-4870-a5d3-436c2f206ac7 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] 10.222.0.30 "POST /compute/v2.1/servers/1e267da4-1e48-4136-babc-656ccd50aae2/action" status: 200 len: 28180 microversion: 2.1 time: 0.088740 Dec 24 10:51:32.997396 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 520/1036] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Dec 24 10:51:32 2021] POST /compute/v2.1/servers/1e267da4-1e48-4136-babc-656ccd50aae2/action => generated 28180 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 24 10:51:33.163359 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-07ff7da1-06ce-4963-b6bf-10511380871f tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:51:33.163979 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-07ff7da1-06ce-4963-b6bf-10511380871f tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] [instance: 6d8fff5e-934d-469e-8a9b-8457f3a062cf] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:51:33.170335 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-07ff7da1-06ce-4963-b6bf-10511380871f tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:51:33.170785 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-07ff7da1-06ce-4963-b6bf-10511380871f tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:51:33.171580 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-07ff7da1-06ce-4963-b6bf-10511380871f tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:51:33.172120 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-07ff7da1-06ce-4963-b6bf-10511380871f tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:51:33.329431 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-07ff7da1-06ce-4963-b6bf-10511380871f tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b690a952a1704197baf5e653e27160f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0fd34670674906aa9a61200251b76c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:51:33.336633 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-07ff7da1-06ce-4963-b6bf-10511380871f tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] 10.222.0.30 "GET /compute/v2.1/servers/6d8fff5e-934d-469e-8a9b-8457f3a062cf" status: 200 len: 1266 microversion: 2.1 time: 0.177008 Dec 24 10:51:33.337819 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 517/1037] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:51:33 2021] GET /compute/v2.1/servers/6d8fff5e-934d-469e-8a9b-8457f3a062cf => generated 1266 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:51:33.752897 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-12c8c2c8-fd92-470c-a139-5e20c05ed922 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:51:33.753532 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-12c8c2c8-fd92-470c-a139-5e20c05ed922 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] [instance: d2c0f276-f763-4337-a5dd-0c328c8c2e73] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:51:33.760923 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-12c8c2c8-fd92-470c-a139-5e20c05ed922 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:51:33.761366 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-12c8c2c8-fd92-470c-a139-5e20c05ed922 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:51:33.762131 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-12c8c2c8-fd92-470c-a139-5e20c05ed922 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:51:33.762555 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-12c8c2c8-fd92-470c-a139-5e20c05ed922 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:51:33.892711 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-12c8c2c8-fd92-470c-a139-5e20c05ed922 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:51:33.900865 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-12c8c2c8-fd92-470c-a139-5e20c05ed922 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:51:33.905070 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-12c8c2c8-fd92-470c-a139-5e20c05ed922 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:51:33.905070 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-12c8c2c8-fd92-470c-a139-5e20c05ed922 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] 10.222.0.30 "GET /compute/v2.1/servers/d2c0f276-f763-4337-a5dd-0c328c8c2e73" status: 200 len: 1721 microversion: 2.20 time: 0.154835 Dec 24 10:51:33.905070 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 521/1038] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Dec 24 10:51:33 2021] GET /compute/v2.1/servers/d2c0f276-f763-4337-a5dd-0c328c8c2e73 => generated 1721 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 10:51:34.007452 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-387cb6b1-c2d0-42da-94c4-419e57ff8f36 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:51:34.008285 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-387cb6b1-c2d0-42da-94c4-419e57ff8f36 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] [instance: 1e267da4-1e48-4136-babc-656ccd50aae2] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:51:34.014682 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-387cb6b1-c2d0-42da-94c4-419e57ff8f36 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:51:34.015132 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-387cb6b1-c2d0-42da-94c4-419e57ff8f36 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:51:34.015917 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-387cb6b1-c2d0-42da-94c4-419e57ff8f36 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:51:34.016607 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-387cb6b1-c2d0-42da-94c4-419e57ff8f36 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:51:34.080949 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-387cb6b1-c2d0-42da-94c4-419e57ff8f36 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] 10.222.0.30 "POST /compute/v2.1/servers/1e267da4-1e48-4136-babc-656ccd50aae2/action" status: 200 len: 28180 microversion: 2.1 time: 0.077108 Dec 24 10:51:34.081564 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 518/1039] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Dec 24 10:51:34 2021] POST /compute/v2.1/servers/1e267da4-1e48-4136-babc-656ccd50aae2/action => generated 28180 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 24 10:51:34.355326 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-cd648a57-8b1a-4944-9526-5894c4cfc960 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:51:34.355883 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-cd648a57-8b1a-4944-9526-5894c4cfc960 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] [instance: 6d8fff5e-934d-469e-8a9b-8457f3a062cf] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:51:34.362319 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-cd648a57-8b1a-4944-9526-5894c4cfc960 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:51:34.362868 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-cd648a57-8b1a-4944-9526-5894c4cfc960 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:51:34.363533 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-cd648a57-8b1a-4944-9526-5894c4cfc960 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:51:34.363966 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-cd648a57-8b1a-4944-9526-5894c4cfc960 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:51:34.499578 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-cd648a57-8b1a-4944-9526-5894c4cfc960 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b690a952a1704197baf5e653e27160f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0fd34670674906aa9a61200251b76c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:51:34.507230 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-cd648a57-8b1a-4944-9526-5894c4cfc960 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] 10.222.0.30 "GET /compute/v2.1/servers/6d8fff5e-934d-469e-8a9b-8457f3a062cf" status: 200 len: 1266 microversion: 2.1 time: 0.156321 Dec 24 10:51:34.507873 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 522/1040] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:51:34 2021] GET /compute/v2.1/servers/6d8fff5e-934d-469e-8a9b-8457f3a062cf => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:51:34.834406 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [req-98d3c0b1-81ac-47f0-b69d-b69c22f185ce req-1360e68d-014a-40fe-b781-cf1d382f7ed0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2c0f276-f763-4337-a5dd-0c328c8c2e73", "name": "network-vif-unplugged", "status": "completed", "tag": "4043d4f5-4811-4ba4-8723-4f04e5548d1c"}]} {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:51:34.834406 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 10:51:34.834406 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: warnings.warn(msg) Dec 24 10:51:34.842094 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [req-98d3c0b1-81ac-47f0-b69d-b69c22f185ce req-1360e68d-014a-40fe-b781-cf1d382f7ed0 service nova] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:51:34.843292 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [req-98d3c0b1-81ac-47f0-b69d-b69c22f185ce req-1360e68d-014a-40fe-b781-cf1d382f7ed0 service nova] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:51:34.855079 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.compute.server_external_events [req-98d3c0b1-81ac-47f0-b69d-b69c22f185ce req-1360e68d-014a-40fe-b781-cf1d382f7ed0 service nova] Creating event network-vif-unplugged:4043d4f5-4811-4ba4-8723-4f04e5548d1c for instance d2c0f276-f763-4337-a5dd-0c328c8c2e73 on hv-cinder-81644 Dec 24 10:51:34.859718 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [req-98d3c0b1-81ac-47f0-b69d-b69c22f185ce req-1360e68d-014a-40fe-b781-cf1d382f7ed0 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032408 Dec 24 10:51:34.860584 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 519/1041] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Dec 24 10:51:34 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 10:51:34.922753 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-284039fd-9202-44a7-8c6d-5794809d3cf1 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:51:34.923343 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-284039fd-9202-44a7-8c6d-5794809d3cf1 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] [instance: d2c0f276-f763-4337-a5dd-0c328c8c2e73] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:51:34.929796 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-284039fd-9202-44a7-8c6d-5794809d3cf1 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:51:34.930246 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-284039fd-9202-44a7-8c6d-5794809d3cf1 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:51:34.931710 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-284039fd-9202-44a7-8c6d-5794809d3cf1 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:51:34.932144 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-284039fd-9202-44a7-8c6d-5794809d3cf1 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:51:35.064168 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-284039fd-9202-44a7-8c6d-5794809d3cf1 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:51:35.071948 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-284039fd-9202-44a7-8c6d-5794809d3cf1 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:51:35.073452 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-284039fd-9202-44a7-8c6d-5794809d3cf1 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:51:35.074597 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-284039fd-9202-44a7-8c6d-5794809d3cf1 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] 10.222.0.30 "GET /compute/v2.1/servers/d2c0f276-f763-4337-a5dd-0c328c8c2e73" status: 200 len: 1721 microversion: 2.20 time: 0.156295 Dec 24 10:51:35.075183 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 523/1042] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Dec 24 10:51:34 2021] GET /compute/v2.1/servers/d2c0f276-f763-4337-a5dd-0c328c8c2e73 => generated 1721 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 10:51:35.094121 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-0a3a0448-a391-4031-89d4-b7db7b0420b5 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:51:35.095277 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-0a3a0448-a391-4031-89d4-b7db7b0420b5 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] [instance: 1e267da4-1e48-4136-babc-656ccd50aae2] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:51:35.102190 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-0a3a0448-a391-4031-89d4-b7db7b0420b5 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:51:35.103191 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-0a3a0448-a391-4031-89d4-b7db7b0420b5 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:51:35.103986 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-0a3a0448-a391-4031-89d4-b7db7b0420b5 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:51:35.104435 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-0a3a0448-a391-4031-89d4-b7db7b0420b5 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:51:35.180078 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-0a3a0448-a391-4031-89d4-b7db7b0420b5 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] 10.222.0.30 "POST /compute/v2.1/servers/1e267da4-1e48-4136-babc-656ccd50aae2/action" status: 200 len: 28471 microversion: 2.1 time: 0.090107 Dec 24 10:51:35.180993 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 520/1043] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Dec 24 10:51:35 2021] POST /compute/v2.1/servers/1e267da4-1e48-4136-babc-656ccd50aae2/action => generated 28471 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 24 10:51:35.523259 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-4e8ec542-4f49-4761-88f4-8d4c185b152a tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:51:35.524036 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-4e8ec542-4f49-4761-88f4-8d4c185b152a tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] [instance: 6d8fff5e-934d-469e-8a9b-8457f3a062cf] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:51:35.530694 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-4e8ec542-4f49-4761-88f4-8d4c185b152a tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:51:35.531137 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-4e8ec542-4f49-4761-88f4-8d4c185b152a tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:51:35.531911 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-4e8ec542-4f49-4761-88f4-8d4c185b152a tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:51:35.532345 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-4e8ec542-4f49-4761-88f4-8d4c185b152a tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:51:35.662998 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-4e8ec542-4f49-4761-88f4-8d4c185b152a tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b690a952a1704197baf5e653e27160f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0fd34670674906aa9a61200251b76c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:51:35.670801 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-4e8ec542-4f49-4761-88f4-8d4c185b152a tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] 10.222.0.30 "GET /compute/v2.1/servers/6d8fff5e-934d-469e-8a9b-8457f3a062cf" status: 200 len: 1266 microversion: 2.1 time: 0.151100 Dec 24 10:51:35.671363 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 524/1044] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:51:35 2021] GET /compute/v2.1/servers/6d8fff5e-934d-469e-8a9b-8457f3a062cf => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 24 10:51:36.093671 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-e2c079a4-0db4-4c04-80a7-d385380e0528 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:51:36.094369 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-e2c079a4-0db4-4c04-80a7-d385380e0528 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] [instance: d2c0f276-f763-4337-a5dd-0c328c8c2e73] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:51:36.101221 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-e2c079a4-0db4-4c04-80a7-d385380e0528 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:51:36.101672 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-e2c079a4-0db4-4c04-80a7-d385380e0528 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:51:36.102940 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-e2c079a4-0db4-4c04-80a7-d385380e0528 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:51:36.103386 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-e2c079a4-0db4-4c04-80a7-d385380e0528 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:51:36.191448 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-2d2a5fe1-0938-4d4c-9cba-121d6de46672 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:51:36.192359 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-2d2a5fe1-0938-4d4c-9cba-121d6de46672 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] [instance: 1e267da4-1e48-4136-babc-656ccd50aae2] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:51:36.198402 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-2d2a5fe1-0938-4d4c-9cba-121d6de46672 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:51:36.198845 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-2d2a5fe1-0938-4d4c-9cba-121d6de46672 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:51:36.199619 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-2d2a5fe1-0938-4d4c-9cba-121d6de46672 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:51:36.200102 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-2d2a5fe1-0938-4d4c-9cba-121d6de46672 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:51:36.234865 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-e2c079a4-0db4-4c04-80a7-d385380e0528 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:51:36.244981 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-e2c079a4-0db4-4c04-80a7-d385380e0528 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:51:36.261928 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-e2c079a4-0db4-4c04-80a7-d385380e0528 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:51:36.261928 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-e2c079a4-0db4-4c04-80a7-d385380e0528 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] 10.222.0.30 "GET /compute/v2.1/servers/d2c0f276-f763-4337-a5dd-0c328c8c2e73" status: 200 len: 1724 microversion: 2.20 time: 0.158071 Dec 24 10:51:36.261928 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 521/1045] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Dec 24 10:51:36 2021] GET /compute/v2.1/servers/d2c0f276-f763-4337-a5dd-0c328c8c2e73 => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 10:51:36.265523 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-66323e2b-fd47-4fce-9b17-d8f583a023e8 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fd7b1364-d0ab-4e28-9a62-4ff6c1ce0c4a"}} {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:51:36.266811 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-66323e2b-fd47-4fce-9b17-d8f583a023e8 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] [instance: d2c0f276-f763-4337-a5dd-0c328c8c2e73] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:51:36.272774 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-66323e2b-fd47-4fce-9b17-d8f583a023e8 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:51:36.273178 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-66323e2b-fd47-4fce-9b17-d8f583a023e8 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:51:36.273956 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-66323e2b-fd47-4fce-9b17-d8f583a023e8 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:51:36.275039 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-66323e2b-fd47-4fce-9b17-d8f583a023e8 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:51:36.291353 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-2d2a5fe1-0938-4d4c-9cba-121d6de46672 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] 10.222.0.30 "POST /compute/v2.1/servers/1e267da4-1e48-4136-babc-656ccd50aae2/action" status: 200 len: 28638 microversion: 2.1 time: 0.100252 Dec 24 10:51:36.291353 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 525/1046] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Dec 24 10:51:36 2021] POST /compute/v2.1/servers/1e267da4-1e48-4136-babc-656ccd50aae2/action => generated 28638 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 24 10:51:36.687098 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-ccbc3e42-ddae-4204-835b-edf134a7a4ad tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:51:36.687834 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-ccbc3e42-ddae-4204-835b-edf134a7a4ad tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] [instance: 6d8fff5e-934d-469e-8a9b-8457f3a062cf] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:51:36.694681 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-ccbc3e42-ddae-4204-835b-edf134a7a4ad tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:51:36.695124 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-ccbc3e42-ddae-4204-835b-edf134a7a4ad tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:51:36.695896 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-ccbc3e42-ddae-4204-835b-edf134a7a4ad tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:51:36.696326 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-ccbc3e42-ddae-4204-835b-edf134a7a4ad tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:51:36.826323 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-ccbc3e42-ddae-4204-835b-edf134a7a4ad tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b690a952a1704197baf5e653e27160f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0fd34670674906aa9a61200251b76c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:51:36.834215 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-ccbc3e42-ddae-4204-835b-edf134a7a4ad tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] 10.222.0.30 "GET /compute/v2.1/servers/6d8fff5e-934d-469e-8a9b-8457f3a062cf" status: 200 len: 1266 microversion: 2.1 time: 0.151052 Dec 24 10:51:36.834715 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 526/1047] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:51:36 2021] GET /compute/v2.1/servers/6d8fff5e-934d-469e-8a9b-8457f3a062cf => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 24 10:51:36.972641 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-bf711493-8c07-45e8-8cc3-34b0b62682b6 tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:51:36.973173 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-bf711493-8c07-45e8-8cc3-34b0b62682b6 tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] [instance: 90bed19f-dc1d-408e-8520-34e390ac92cd] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:51:36.979350 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-bf711493-8c07-45e8-8cc3-34b0b62682b6 tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:51:36.979796 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-bf711493-8c07-45e8-8cc3-34b0b62682b6 tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:51:36.980570 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-bf711493-8c07-45e8-8cc3-34b0b62682b6 tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:51:36.981030 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-bf711493-8c07-45e8-8cc3-34b0b62682b6 tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:51:37.058405 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.objects.instance [None req-bf711493-8c07-45e8-8cc3-34b0b62682b6 tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] Lazy-loading 'services' on Instance uuid 90bed19f-dc1d-408e-8520-34e390ac92cd {{(pid=123431) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 24 10:51:37.369935 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-bf711493-8c07-45e8-8cc3-34b0b62682b6 tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] 10.222.0.30 "DELETE /compute/v2.1/servers/90bed19f-dc1d-408e-8520-34e390ac92cd/os-volume_attachments/2c915293-fc86-490b-9fb0-9f6096090d39" status: 202 len: 0 microversion: 2.1 time: 0.400814 Dec 24 10:51:37.370700 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 527/1048] 10.222.0.30 () {58 vars in 1415 bytes} [Fri Dec 24 10:51:36 2021] DELETE /compute/v2.1/servers/90bed19f-dc1d-408e-8520-34e390ac92cd/os-volume_attachments/2c915293-fc86-490b-9fb0-9f6096090d39 => generated 0 bytes in 402 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Dec 24 10:51:37.379906 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-d72b3c73-9e5e-43c8-ac63-a0e1172d9cb6 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:51:37.381157 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-d72b3c73-9e5e-43c8-ac63-a0e1172d9cb6 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] [instance: 1e267da4-1e48-4136-babc-656ccd50aae2] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:51:37.394413 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-d72b3c73-9e5e-43c8-ac63-a0e1172d9cb6 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:51:37.394857 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-d72b3c73-9e5e-43c8-ac63-a0e1172d9cb6 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:51:37.395647 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-d72b3c73-9e5e-43c8-ac63-a0e1172d9cb6 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:51:37.396072 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-d72b3c73-9e5e-43c8-ac63-a0e1172d9cb6 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:51:37.471338 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-d72b3c73-9e5e-43c8-ac63-a0e1172d9cb6 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] 10.222.0.30 "POST /compute/v2.1/servers/1e267da4-1e48-4136-babc-656ccd50aae2/action" status: 200 len: 28638 microversion: 2.1 time: 0.096147 Dec 24 10:51:37.474840 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 528/1049] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Dec 24 10:51:37 2021] POST /compute/v2.1/servers/1e267da4-1e48-4136-babc-656ccd50aae2/action => generated 28638 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 24 10:51:37.851844 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-1da8cc1d-1d90-4a7d-b5c4-7bbed621f116 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:51:37.852760 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-1da8cc1d-1d90-4a7d-b5c4-7bbed621f116 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] [instance: 6d8fff5e-934d-469e-8a9b-8457f3a062cf] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:51:37.859631 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-1da8cc1d-1d90-4a7d-b5c4-7bbed621f116 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:51:37.860085 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-1da8cc1d-1d90-4a7d-b5c4-7bbed621f116 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:51:37.860902 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-1da8cc1d-1d90-4a7d-b5c4-7bbed621f116 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:51:37.861346 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-1da8cc1d-1d90-4a7d-b5c4-7bbed621f116 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:51:37.944808 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-66323e2b-fd47-4fce-9b17-d8f583a023e8 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] 10.222.0.30 "POST /compute/v2.1/servers/d2c0f276-f763-4337-a5dd-0c328c8c2e73/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.682917 Dec 24 10:51:37.950926 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 522/1050] 10.222.0.30 () {62 vars in 1363 bytes} [Fri Dec 24 10:51:36 2021] POST /compute/v2.1/servers/d2c0f276-f763-4337-a5dd-0c328c8c2e73/os-volume_attachments => generated 188 bytes in 1690 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 24 10:51:38.048940 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-1da8cc1d-1d90-4a7d-b5c4-7bbed621f116 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b690a952a1704197baf5e653e27160f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0fd34670674906aa9a61200251b76c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:51:38.057084 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-1da8cc1d-1d90-4a7d-b5c4-7bbed621f116 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] 10.222.0.30 "GET /compute/v2.1/servers/6d8fff5e-934d-469e-8a9b-8457f3a062cf" status: 200 len: 1266 microversion: 2.1 time: 0.209094 Dec 24 10:51:38.061397 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 529/1051] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:51:37 2021] GET /compute/v2.1/servers/6d8fff5e-934d-469e-8a9b-8457f3a062cf => generated 1266 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 24 10:51:38.069890 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-eaccb8cc-5c92-4225-8409-3f80800881f8 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:51:38.070389 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-eaccb8cc-5c92-4225-8409-3f80800881f8 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] [instance: d2c0f276-f763-4337-a5dd-0c328c8c2e73] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:51:38.077015 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-eaccb8cc-5c92-4225-8409-3f80800881f8 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:51:38.077461 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-eaccb8cc-5c92-4225-8409-3f80800881f8 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:51:38.078240 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-eaccb8cc-5c92-4225-8409-3f80800881f8 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:51:38.078668 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-eaccb8cc-5c92-4225-8409-3f80800881f8 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:51:38.483038 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-ea85de1f-37f7-4725-9b27-0b1f589dc708 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:51:38.484196 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-ea85de1f-37f7-4725-9b27-0b1f589dc708 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] [instance: 1e267da4-1e48-4136-babc-656ccd50aae2] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:51:38.491573 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-ea85de1f-37f7-4725-9b27-0b1f589dc708 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:51:38.492022 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-ea85de1f-37f7-4725-9b27-0b1f589dc708 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:51:38.492830 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-ea85de1f-37f7-4725-9b27-0b1f589dc708 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:51:38.493270 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-ea85de1f-37f7-4725-9b27-0b1f589dc708 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:51:38.570264 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-ea85de1f-37f7-4725-9b27-0b1f589dc708 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] 10.222.0.30 "POST /compute/v2.1/servers/1e267da4-1e48-4136-babc-656ccd50aae2/action" status: 200 len: 28638 microversion: 2.1 time: 0.090962 Dec 24 10:51:38.570944 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 530/1052] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Dec 24 10:51:38 2021] POST /compute/v2.1/servers/1e267da4-1e48-4136-babc-656ccd50aae2/action => generated 28638 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 24 10:51:39.077311 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-c89b8513-d20d-4410-b059-3502c1877755 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:51:39.078002 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-c89b8513-d20d-4410-b059-3502c1877755 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] [instance: 6d8fff5e-934d-469e-8a9b-8457f3a062cf] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:51:39.084788 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-c89b8513-d20d-4410-b059-3502c1877755 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:51:39.085266 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-c89b8513-d20d-4410-b059-3502c1877755 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:51:39.086040 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-c89b8513-d20d-4410-b059-3502c1877755 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:51:39.086473 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-c89b8513-d20d-4410-b059-3502c1877755 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:51:39.224754 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-c89b8513-d20d-4410-b059-3502c1877755 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b690a952a1704197baf5e653e27160f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0fd34670674906aa9a61200251b76c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:51:39.232257 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-c89b8513-d20d-4410-b059-3502c1877755 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] 10.222.0.30 "GET /compute/v2.1/servers/6d8fff5e-934d-469e-8a9b-8457f3a062cf" status: 200 len: 1266 microversion: 2.1 time: 0.159003 Dec 24 10:51:39.233176 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 531/1053] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:51:39 2021] GET /compute/v2.1/servers/6d8fff5e-934d-469e-8a9b-8457f3a062cf => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 24 10:51:39.407668 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-eaccb8cc-5c92-4225-8409-3f80800881f8 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] 10.222.0.30 "DELETE /compute/v2.1/servers/d2c0f276-f763-4337-a5dd-0c328c8c2e73/os-volume_attachments/fd7b1364-d0ab-4e28-9a62-4ff6c1ce0c4a" status: 202 len: 0 microversion: 2.20 time: 1.343417 Dec 24 10:51:39.408403 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 523/1054] 10.222.0.30 () {60 vars in 1456 bytes} [Fri Dec 24 10:51:38 2021] DELETE /compute/v2.1/servers/d2c0f276-f763-4337-a5dd-0c328c8c2e73/os-volume_attachments/fd7b1364-d0ab-4e28-9a62-4ff6c1ce0c4a => generated 0 bytes in 1345 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Dec 24 10:51:39.459890 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-4fac8166-a5ba-4d7d-bdc2-fc5d561d75b3 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:51:39.462546 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-4fac8166-a5ba-4d7d-bdc2-fc5d561d75b3 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] [instance: d2c0f276-f763-4337-a5dd-0c328c8c2e73] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:51:39.467377 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-4fac8166-a5ba-4d7d-bdc2-fc5d561d75b3 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:51:39.467830 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-4fac8166-a5ba-4d7d-bdc2-fc5d561d75b3 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:51:39.468612 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-4fac8166-a5ba-4d7d-bdc2-fc5d561d75b3 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:51:39.469145 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-4fac8166-a5ba-4d7d-bdc2-fc5d561d75b3 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:51:39.556727 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-2de29d07-a12e-457d-9335-2e954d2d260f tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:51:39.557265 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-2de29d07-a12e-457d-9335-2e954d2d260f tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] [instance: 90bed19f-dc1d-408e-8520-34e390ac92cd] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:51:39.563616 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-2de29d07-a12e-457d-9335-2e954d2d260f tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:51:39.564074 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-2de29d07-a12e-457d-9335-2e954d2d260f tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:51:39.564893 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-2de29d07-a12e-457d-9335-2e954d2d260f tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:51:39.565332 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-2de29d07-a12e-457d-9335-2e954d2d260f tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:51:39.590433 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-2de29d07-a12e-457d-9335-2e954d2d260f tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] [instance: 90bed19f-dc1d-408e-8520-34e390ac92cd] Going to try to terminate instance {{(pid=123432) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 24 10:51:39.793295 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-4fac8166-a5ba-4d7d-bdc2-fc5d561d75b3 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] 10.222.0.30 "POST /compute/v2.1/servers/d2c0f276-f763-4337-a5dd-0c328c8c2e73/action" status: 202 len: 0 microversion: 2.20 time: 0.337180 Dec 24 10:51:39.793980 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 532/1055] 10.222.0.30 () {62 vars in 1318 bytes} [Fri Dec 24 10:51:39 2021] POST /compute/v2.1/servers/d2c0f276-f763-4337-a5dd-0c328c8c2e73/action => generated 0 bytes in 339 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Dec 24 10:51:39.801507 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-bbb4cc58-dd8e-4bc5-922c-00e0d418180b tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:51:39.802406 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-bbb4cc58-dd8e-4bc5-922c-00e0d418180b tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] [instance: 1e267da4-1e48-4136-babc-656ccd50aae2] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:51:39.809219 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-bbb4cc58-dd8e-4bc5-922c-00e0d418180b tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:51:39.809673 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-bbb4cc58-dd8e-4bc5-922c-00e0d418180b tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:51:39.810445 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-bbb4cc58-dd8e-4bc5-922c-00e0d418180b tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:51:39.810880 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-bbb4cc58-dd8e-4bc5-922c-00e0d418180b tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:51:39.874749 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-bbb4cc58-dd8e-4bc5-922c-00e0d418180b tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] 10.222.0.30 "POST /compute/v2.1/servers/1e267da4-1e48-4136-babc-656ccd50aae2/action" status: 200 len: 28638 microversion: 2.1 time: 0.076567 Dec 24 10:51:39.875390 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 533/1056] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Dec 24 10:51:39 2021] POST /compute/v2.1/servers/1e267da4-1e48-4136-babc-656ccd50aae2/action => generated 28638 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 24 10:51:39.880314 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-d1a009fd-60b0-442f-bfae-7fdd4efe43d6 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:51:39.881027 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-d1a009fd-60b0-442f-bfae-7fdd4efe43d6 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] [instance: d2c0f276-f763-4337-a5dd-0c328c8c2e73] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:51:39.888288 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-d1a009fd-60b0-442f-bfae-7fdd4efe43d6 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:51:39.888734 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-d1a009fd-60b0-442f-bfae-7fdd4efe43d6 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:51:39.889539 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-d1a009fd-60b0-442f-bfae-7fdd4efe43d6 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:51:39.889972 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-d1a009fd-60b0-442f-bfae-7fdd4efe43d6 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:51:40.052403 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-d1a009fd-60b0-442f-bfae-7fdd4efe43d6 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:51:40.052403 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-d1a009fd-60b0-442f-bfae-7fdd4efe43d6 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:51:40.052853 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-d1a009fd-60b0-442f-bfae-7fdd4efe43d6 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:51:40.052853 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-d1a009fd-60b0-442f-bfae-7fdd4efe43d6 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] 10.222.0.30 "GET /compute/v2.1/servers/d2c0f276-f763-4337-a5dd-0c328c8c2e73" status: 200 len: 1672 microversion: 2.20 time: 0.175369 Dec 24 10:51:40.052853 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 534/1057] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Dec 24 10:51:39 2021] GET /compute/v2.1/servers/d2c0f276-f763-4337-a5dd-0c328c8c2e73 => generated 1672 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 10:51:40.168060 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-2de29d07-a12e-457d-9335-2e954d2d260f tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] 10.222.0.30 "DELETE /compute/v2.1/servers/90bed19f-dc1d-408e-8520-34e390ac92cd" status: 204 len: 0 microversion: 2.1 time: 0.615256 Dec 24 10:51:40.168761 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 524/1058] 10.222.0.30 () {58 vars in 1238 bytes} [Fri Dec 24 10:51:39 2021] DELETE /compute/v2.1/servers/90bed19f-dc1d-408e-8520-34e390ac92cd => generated 0 bytes in 617 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Dec 24 10:51:40.177715 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-be5c70da-6270-4b90-aa2e-3a01539c3f8c tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:51:40.178396 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-be5c70da-6270-4b90-aa2e-3a01539c3f8c tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] [instance: 90bed19f-dc1d-408e-8520-34e390ac92cd] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:51:40.184953 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-be5c70da-6270-4b90-aa2e-3a01539c3f8c tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:51:40.185406 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-be5c70da-6270-4b90-aa2e-3a01539c3f8c tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:51:40.186185 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-be5c70da-6270-4b90-aa2e-3a01539c3f8c tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:51:40.186630 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-be5c70da-6270-4b90-aa2e-3a01539c3f8c tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:51:40.249725 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-646585ba-79dd-45d5-a079-346e5a4cbda5 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:51:40.250423 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-646585ba-79dd-45d5-a079-346e5a4cbda5 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] [instance: 6d8fff5e-934d-469e-8a9b-8457f3a062cf] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:51:40.256859 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-646585ba-79dd-45d5-a079-346e5a4cbda5 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:51:40.257524 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-646585ba-79dd-45d5-a079-346e5a4cbda5 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:51:40.258333 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-646585ba-79dd-45d5-a079-346e5a4cbda5 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:51:40.259393 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-646585ba-79dd-45d5-a079-346e5a4cbda5 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:51:40.339907 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-be5c70da-6270-4b90-aa2e-3a01539c3f8c tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc441b6f06b44beb2a85f854cf92dd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696f3d18f3af4e0eb5760d829e0c3977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:51:40.348179 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-be5c70da-6270-4b90-aa2e-3a01539c3f8c tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] 10.222.0.30 "GET /compute/v2.1/servers/90bed19f-dc1d-408e-8520-34e390ac92cd" status: 200 len: 1512 microversion: 2.1 time: 0.174964 Dec 24 10:51:40.349437 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 535/1059] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:51:40 2021] GET /compute/v2.1/servers/90bed19f-dc1d-408e-8520-34e390ac92cd => generated 1512 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:51:40.417545 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-646585ba-79dd-45d5-a079-346e5a4cbda5 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b690a952a1704197baf5e653e27160f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0fd34670674906aa9a61200251b76c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:51:40.425028 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-646585ba-79dd-45d5-a079-346e5a4cbda5 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] 10.222.0.30 "GET /compute/v2.1/servers/6d8fff5e-934d-469e-8a9b-8457f3a062cf" status: 200 len: 1266 microversion: 2.1 time: 0.179241 Dec 24 10:51:40.425595 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 525/1060] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:51:40 2021] GET /compute/v2.1/servers/6d8fff5e-934d-469e-8a9b-8457f3a062cf => generated 1266 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 24 10:51:40.886251 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-ef49c8a1-72be-4152-9466-96284f3fc67a tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:51:40.887310 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-ef49c8a1-72be-4152-9466-96284f3fc67a tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] [instance: 1e267da4-1e48-4136-babc-656ccd50aae2] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:51:40.893922 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-ef49c8a1-72be-4152-9466-96284f3fc67a tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:51:40.894456 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-ef49c8a1-72be-4152-9466-96284f3fc67a tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:51:40.895322 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-ef49c8a1-72be-4152-9466-96284f3fc67a tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:51:40.895833 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-ef49c8a1-72be-4152-9466-96284f3fc67a tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:51:40.972448 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-ef49c8a1-72be-4152-9466-96284f3fc67a tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] 10.222.0.30 "POST /compute/v2.1/servers/1e267da4-1e48-4136-babc-656ccd50aae2/action" status: 200 len: 30028 microversion: 2.1 time: 0.089749 Dec 24 10:51:40.979115 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 536/1061] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Dec 24 10:51:40 2021] POST /compute/v2.1/servers/1e267da4-1e48-4136-babc-656ccd50aae2/action => generated 30028 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 24 10:51:41.071270 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-6aa098ca-3e7c-43eb-ac09-7ab474fa3abf tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:51:41.072222 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-6aa098ca-3e7c-43eb-ac09-7ab474fa3abf tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] [instance: d2c0f276-f763-4337-a5dd-0c328c8c2e73] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:51:41.078473 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-6aa098ca-3e7c-43eb-ac09-7ab474fa3abf tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:51:41.079049 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-6aa098ca-3e7c-43eb-ac09-7ab474fa3abf tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:51:41.080179 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-6aa098ca-3e7c-43eb-ac09-7ab474fa3abf tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:51:41.080731 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-6aa098ca-3e7c-43eb-ac09-7ab474fa3abf tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:51:41.253164 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-6aa098ca-3e7c-43eb-ac09-7ab474fa3abf tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:51:41.272149 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-6aa098ca-3e7c-43eb-ac09-7ab474fa3abf tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:51:41.273696 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-6aa098ca-3e7c-43eb-ac09-7ab474fa3abf tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:51:41.275369 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-6aa098ca-3e7c-43eb-ac09-7ab474fa3abf tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] 10.222.0.30 "GET /compute/v2.1/servers/d2c0f276-f763-4337-a5dd-0c328c8c2e73" status: 200 len: 1672 microversion: 2.20 time: 0.208040 Dec 24 10:51:41.275931 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 526/1062] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Dec 24 10:51:41 2021] GET /compute/v2.1/servers/d2c0f276-f763-4337-a5dd-0c328c8c2e73 => generated 1672 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 10:51:41.365950 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-200ff7d8-64e3-4fd9-bf2e-47d10e96bb1d tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:51:41.366657 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-200ff7d8-64e3-4fd9-bf2e-47d10e96bb1d tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] [instance: 90bed19f-dc1d-408e-8520-34e390ac92cd] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:51:41.373652 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-200ff7d8-64e3-4fd9-bf2e-47d10e96bb1d tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:51:41.374043 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-200ff7d8-64e3-4fd9-bf2e-47d10e96bb1d tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:51:41.374824 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-200ff7d8-64e3-4fd9-bf2e-47d10e96bb1d tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:51:41.375258 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-200ff7d8-64e3-4fd9-bf2e-47d10e96bb1d tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:51:41.443249 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-c4d28678-734c-40d3-a8a5-cd23bb5bedad tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:51:41.443863 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-c4d28678-734c-40d3-a8a5-cd23bb5bedad tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] [instance: 6d8fff5e-934d-469e-8a9b-8457f3a062cf] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:51:41.451112 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-c4d28678-734c-40d3-a8a5-cd23bb5bedad tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:51:41.451910 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-c4d28678-734c-40d3-a8a5-cd23bb5bedad tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:51:41.452809 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-c4d28678-734c-40d3-a8a5-cd23bb5bedad tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:51:41.453335 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-c4d28678-734c-40d3-a8a5-cd23bb5bedad tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:51:41.543516 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-200ff7d8-64e3-4fd9-bf2e-47d10e96bb1d tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc441b6f06b44beb2a85f854cf92dd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696f3d18f3af4e0eb5760d829e0c3977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:51:41.554847 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-200ff7d8-64e3-4fd9-bf2e-47d10e96bb1d tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] 10.222.0.30 "GET /compute/v2.1/servers/90bed19f-dc1d-408e-8520-34e390ac92cd" status: 200 len: 1512 microversion: 2.1 time: 0.192158 Dec 24 10:51:41.555654 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 537/1063] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:51:41 2021] GET /compute/v2.1/servers/90bed19f-dc1d-408e-8520-34e390ac92cd => generated 1512 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:51:41.925291 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-c4d28678-734c-40d3-a8a5-cd23bb5bedad tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b690a952a1704197baf5e653e27160f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0fd34670674906aa9a61200251b76c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:51:41.933372 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-c4d28678-734c-40d3-a8a5-cd23bb5bedad tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] 10.222.0.30 "GET /compute/v2.1/servers/6d8fff5e-934d-469e-8a9b-8457f3a062cf" status: 200 len: 1266 microversion: 2.1 time: 0.495365 Dec 24 10:51:41.942248 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 527/1064] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:51:41 2021] GET /compute/v2.1/servers/6d8fff5e-934d-469e-8a9b-8457f3a062cf => generated 1266 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:51:41.983416 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-153196e3-7366-49fc-8cd3-7b1d4f6b33f4 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:51:41.984332 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-153196e3-7366-49fc-8cd3-7b1d4f6b33f4 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] [instance: 1e267da4-1e48-4136-babc-656ccd50aae2] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:51:41.990966 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-153196e3-7366-49fc-8cd3-7b1d4f6b33f4 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:51:41.991413 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-153196e3-7366-49fc-8cd3-7b1d4f6b33f4 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:51:41.992198 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-153196e3-7366-49fc-8cd3-7b1d4f6b33f4 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:51:41.993360 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-153196e3-7366-49fc-8cd3-7b1d4f6b33f4 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:51:42.068576 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-153196e3-7366-49fc-8cd3-7b1d4f6b33f4 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] 10.222.0.30 "POST /compute/v2.1/servers/1e267da4-1e48-4136-babc-656ccd50aae2/action" status: 200 len: 31570 microversion: 2.1 time: 0.088648 Dec 24 10:51:42.069592 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 538/1065] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Dec 24 10:51:41 2021] POST /compute/v2.1/servers/1e267da4-1e48-4136-babc-656ccd50aae2/action => generated 31570 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 24 10:51:42.293578 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-ef40d955-049c-411f-95df-5bafcfcd98ab tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:51:42.294219 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-ef40d955-049c-411f-95df-5bafcfcd98ab tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] [instance: d2c0f276-f763-4337-a5dd-0c328c8c2e73] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:51:42.300387 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-ef40d955-049c-411f-95df-5bafcfcd98ab tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:51:42.300871 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-ef40d955-049c-411f-95df-5bafcfcd98ab tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:51:42.301672 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-ef40d955-049c-411f-95df-5bafcfcd98ab tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:51:42.302109 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-ef40d955-049c-411f-95df-5bafcfcd98ab tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:51:42.577054 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-7587e263-e263-4b75-b2a3-96ef9f65be75 tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:51:42.578916 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-ef40d955-049c-411f-95df-5bafcfcd98ab tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:51:42.581739 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-7587e263-e263-4b75-b2a3-96ef9f65be75 tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] [instance: 90bed19f-dc1d-408e-8520-34e390ac92cd] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:51:42.596405 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-7587e263-e263-4b75-b2a3-96ef9f65be75 tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:51:42.598558 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-ef40d955-049c-411f-95df-5bafcfcd98ab tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:51:42.600639 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-ef40d955-049c-411f-95df-5bafcfcd98ab tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:51:42.601222 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-7587e263-e263-4b75-b2a3-96ef9f65be75 tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:51:42.602222 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-7587e263-e263-4b75-b2a3-96ef9f65be75 tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:51:42.604190 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-ef40d955-049c-411f-95df-5bafcfcd98ab tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] 10.222.0.30 "GET /compute/v2.1/servers/d2c0f276-f763-4337-a5dd-0c328c8c2e73" status: 200 len: 1730 microversion: 2.20 time: 0.314833 Dec 24 10:51:42.604764 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-7587e263-e263-4b75-b2a3-96ef9f65be75 tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:51:42.613422 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 528/1066] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Dec 24 10:51:42 2021] GET /compute/v2.1/servers/d2c0f276-f763-4337-a5dd-0c328c8c2e73 => generated 1730 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 10:51:42.643053 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [req-5f02fa53-df12-434b-91f2-8d3aee12da84 req-b9dc4cd3-df66-4c62-bc6d-566f3269b5dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90bed19f-dc1d-408e-8520-34e390ac92cd", "name": "network-vif-deleted", "tag": "0a1505e6-626c-4f03-8fa1-81e71b8f72d5"}]} {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:51:42.644750 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 10:51:42.644750 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: warnings.warn(msg) Dec 24 10:51:42.652499 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [req-5f02fa53-df12-434b-91f2-8d3aee12da84 req-b9dc4cd3-df66-4c62-bc6d-566f3269b5dd service nova] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:51:42.652969 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [req-5f02fa53-df12-434b-91f2-8d3aee12da84 req-b9dc4cd3-df66-4c62-bc6d-566f3269b5dd service nova] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:51:42.664185 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.compute.server_external_events [req-5f02fa53-df12-434b-91f2-8d3aee12da84 req-b9dc4cd3-df66-4c62-bc6d-566f3269b5dd service nova] Creating event network-vif-deleted:0a1505e6-626c-4f03-8fa1-81e71b8f72d5 for instance 90bed19f-dc1d-408e-8520-34e390ac92cd on hv-cinder-81644 Dec 24 10:51:42.670357 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [req-5f02fa53-df12-434b-91f2-8d3aee12da84 req-b9dc4cd3-df66-4c62-bc6d-566f3269b5dd service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031087 Dec 24 10:51:42.670956 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 529/1067] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Dec 24 10:51:42 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 24 10:51:42.693782 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-7587e263-e263-4b75-b2a3-96ef9f65be75 tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc441b6f06b44beb2a85f854cf92dd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696f3d18f3af4e0eb5760d829e0c3977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:51:42.701173 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-7587e263-e263-4b75-b2a3-96ef9f65be75 tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] 10.222.0.30 "GET /compute/v2.1/servers/90bed19f-dc1d-408e-8520-34e390ac92cd" status: 200 len: 1470 microversion: 2.1 time: 0.131982 Dec 24 10:51:42.701743 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 539/1068] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:51:42 2021] GET /compute/v2.1/servers/90bed19f-dc1d-408e-8520-34e390ac92cd => generated 1470 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 24 10:51:42.950829 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-9b61f394-2ea3-4efe-892d-5e5a1121cbf0 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:51:42.962731 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-9b61f394-2ea3-4efe-892d-5e5a1121cbf0 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] [instance: 6d8fff5e-934d-469e-8a9b-8457f3a062cf] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:51:42.962731 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-9b61f394-2ea3-4efe-892d-5e5a1121cbf0 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:51:42.962731 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-9b61f394-2ea3-4efe-892d-5e5a1121cbf0 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:51:42.962731 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-9b61f394-2ea3-4efe-892d-5e5a1121cbf0 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:51:42.963132 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-9b61f394-2ea3-4efe-892d-5e5a1121cbf0 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:51:43.080859 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-661ce162-5bbd-4239-a5c1-0a113a161f67 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:51:43.081910 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-661ce162-5bbd-4239-a5c1-0a113a161f67 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] [instance: 1e267da4-1e48-4136-babc-656ccd50aae2] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:51:43.090462 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-661ce162-5bbd-4239-a5c1-0a113a161f67 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:51:43.091177 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-661ce162-5bbd-4239-a5c1-0a113a161f67 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:51:43.092329 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-661ce162-5bbd-4239-a5c1-0a113a161f67 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:51:43.092960 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-661ce162-5bbd-4239-a5c1-0a113a161f67 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:51:43.131634 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-9b61f394-2ea3-4efe-892d-5e5a1121cbf0 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b690a952a1704197baf5e653e27160f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0fd34670674906aa9a61200251b76c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:51:43.140095 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-9b61f394-2ea3-4efe-892d-5e5a1121cbf0 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] 10.222.0.30 "GET /compute/v2.1/servers/6d8fff5e-934d-469e-8a9b-8457f3a062cf" status: 200 len: 1266 microversion: 2.1 time: 0.193883 Dec 24 10:51:43.140695 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 530/1069] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:51:42 2021] GET /compute/v2.1/servers/6d8fff5e-934d-469e-8a9b-8457f3a062cf => generated 1266 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:51:43.177306 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-661ce162-5bbd-4239-a5c1-0a113a161f67 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] 10.222.0.30 "POST /compute/v2.1/servers/1e267da4-1e48-4136-babc-656ccd50aae2/action" status: 200 len: 33204 microversion: 2.1 time: 0.099721 Dec 24 10:51:43.178799 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 540/1070] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Dec 24 10:51:43 2021] POST /compute/v2.1/servers/1e267da4-1e48-4136-babc-656ccd50aae2/action => generated 33204 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 24 10:51:43.295711 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [req-4f457de6-c8f9-42d2-8d13-dd618c9cc304 req-22a8caa4-6538-4ed2-bf12-7ab0a252aae5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d8fff5e-934d-469e-8a9b-8457f3a062cf", "name": "network-vif-plugged", "status": "completed", "tag": "1d65157c-7f7f-44f7-86a3-f01fae63875b"}]} {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:51:43.298194 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 10:51:43.298194 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: warnings.warn(msg) Dec 24 10:51:43.306401 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [req-4f457de6-c8f9-42d2-8d13-dd618c9cc304 req-22a8caa4-6538-4ed2-bf12-7ab0a252aae5 service nova] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:51:43.306917 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [req-4f457de6-c8f9-42d2-8d13-dd618c9cc304 req-22a8caa4-6538-4ed2-bf12-7ab0a252aae5 service nova] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:51:43.318049 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.compute.server_external_events [req-4f457de6-c8f9-42d2-8d13-dd618c9cc304 req-22a8caa4-6538-4ed2-bf12-7ab0a252aae5 service nova] Creating event network-vif-plugged:1d65157c-7f7f-44f7-86a3-f01fae63875b for instance 6d8fff5e-934d-469e-8a9b-8457f3a062cf on hv-cinder-81644 Dec 24 10:51:43.324089 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [req-4f457de6-c8f9-42d2-8d13-dd618c9cc304 req-22a8caa4-6538-4ed2-bf12-7ab0a252aae5 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032077 Dec 24 10:51:43.325138 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 531/1071] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Dec 24 10:51:43 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 10:51:43.625360 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-0efb4b84-d32c-4e1f-ab53-13b0933c3634 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:51:43.629828 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-0efb4b84-d32c-4e1f-ab53-13b0933c3634 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] [instance: d2c0f276-f763-4337-a5dd-0c328c8c2e73] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:51:43.637049 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-0efb4b84-d32c-4e1f-ab53-13b0933c3634 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:51:43.637781 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-0efb4b84-d32c-4e1f-ab53-13b0933c3634 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:51:43.638787 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-0efb4b84-d32c-4e1f-ab53-13b0933c3634 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:51:43.639411 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-0efb4b84-d32c-4e1f-ab53-13b0933c3634 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:51:43.718121 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-b20e03f5-22eb-40ef-b865-5d7da988951b tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:51:43.718821 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-b20e03f5-22eb-40ef-b865-5d7da988951b tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] [instance: 90bed19f-dc1d-408e-8520-34e390ac92cd] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:51:43.725340 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-b20e03f5-22eb-40ef-b865-5d7da988951b tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:51:43.726060 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-b20e03f5-22eb-40ef-b865-5d7da988951b tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:51:43.726858 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-b20e03f5-22eb-40ef-b865-5d7da988951b tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:51:43.727840 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-b20e03f5-22eb-40ef-b865-5d7da988951b tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:51:43.782881 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-b20e03f5-22eb-40ef-b865-5d7da988951b tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:51:43.785960 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-b20e03f5-22eb-40ef-b865-5d7da988951b tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:51:43.788416 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.objects.instance [None req-b20e03f5-22eb-40ef-b865-5d7da988951b tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] Lazy-loading 'fault' on Instance uuid 90bed19f-dc1d-408e-8520-34e390ac92cd {{(pid=123432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 24 10:51:43.823209 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-0efb4b84-d32c-4e1f-ab53-13b0933c3634 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:51:43.839854 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-0efb4b84-d32c-4e1f-ab53-13b0933c3634 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:51:43.841666 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-0efb4b84-d32c-4e1f-ab53-13b0933c3634 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:51:43.843031 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-0efb4b84-d32c-4e1f-ab53-13b0933c3634 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] 10.222.0.30 "GET /compute/v2.1/servers/d2c0f276-f763-4337-a5dd-0c328c8c2e73" status: 200 len: 1730 microversion: 2.20 time: 0.223639 Dec 24 10:51:43.845188 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 541/1072] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Dec 24 10:51:43 2021] GET /compute/v2.1/servers/d2c0f276-f763-4337-a5dd-0c328c8c2e73 => generated 1730 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 10:51:43.856371 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-b20e03f5-22eb-40ef-b865-5d7da988951b tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc441b6f06b44beb2a85f854cf92dd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696f3d18f3af4e0eb5760d829e0c3977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:51:43.865419 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-b20e03f5-22eb-40ef-b865-5d7da988951b tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] 10.222.0.30 "GET /compute/v2.1/servers/90bed19f-dc1d-408e-8520-34e390ac92cd" status: 200 len: 1308 microversion: 2.1 time: 0.151176 Dec 24 10:51:43.866597 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 532/1073] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:51:43 2021] GET /compute/v2.1/servers/90bed19f-dc1d-408e-8520-34e390ac92cd => generated 1308 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 24 10:51:44.157108 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-454a853b-c3e8-480e-9035-025759ebc2ad tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:51:44.157995 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-454a853b-c3e8-480e-9035-025759ebc2ad tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] [instance: 6d8fff5e-934d-469e-8a9b-8457f3a062cf] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:51:44.164446 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-454a853b-c3e8-480e-9035-025759ebc2ad tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:51:44.165499 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-454a853b-c3e8-480e-9035-025759ebc2ad tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:51:44.166358 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-454a853b-c3e8-480e-9035-025759ebc2ad tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:51:44.166783 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-454a853b-c3e8-480e-9035-025759ebc2ad tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:51:44.189674 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-71232177-acbd-4adf-913c-556ef93fbc57 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:51:44.190650 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-71232177-acbd-4adf-913c-556ef93fbc57 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] [instance: 1e267da4-1e48-4136-babc-656ccd50aae2] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:51:44.196778 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-71232177-acbd-4adf-913c-556ef93fbc57 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:51:44.197265 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-71232177-acbd-4adf-913c-556ef93fbc57 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:51:44.198053 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-71232177-acbd-4adf-913c-556ef93fbc57 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:51:44.198490 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-71232177-acbd-4adf-913c-556ef93fbc57 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:51:44.296500 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-454a853b-c3e8-480e-9035-025759ebc2ad tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b690a952a1704197baf5e653e27160f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0fd34670674906aa9a61200251b76c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:51:44.303965 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-454a853b-c3e8-480e-9035-025759ebc2ad tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] 10.222.0.30 "GET /compute/v2.1/servers/6d8fff5e-934d-469e-8a9b-8457f3a062cf" status: 200 len: 1266 microversion: 2.1 time: 0.150442 Dec 24 10:51:44.304545 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 542/1074] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:51:44 2021] GET /compute/v2.1/servers/6d8fff5e-934d-469e-8a9b-8457f3a062cf => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:51:44.430944 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-71232177-acbd-4adf-913c-556ef93fbc57 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] 10.222.0.30 "POST /compute/v2.1/servers/1e267da4-1e48-4136-babc-656ccd50aae2/action" status: 200 len: 34266 microversion: 2.1 time: 0.242812 Dec 24 10:51:44.438836 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 533/1075] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Dec 24 10:51:44 2021] POST /compute/v2.1/servers/1e267da4-1e48-4136-babc-656ccd50aae2/action => generated 34266 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 24 10:51:44.863767 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-f5af54ae-c3a7-482b-bc6d-70171501bc60 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:51:44.865200 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-f5af54ae-c3a7-482b-bc6d-70171501bc60 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] [instance: d2c0f276-f763-4337-a5dd-0c328c8c2e73] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:51:44.877394 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-f5af54ae-c3a7-482b-bc6d-70171501bc60 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:51:44.878253 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-f5af54ae-c3a7-482b-bc6d-70171501bc60 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:51:44.880559 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-f5af54ae-c3a7-482b-bc6d-70171501bc60 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:51:44.881187 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-f5af54ae-c3a7-482b-bc6d-70171501bc60 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:51:44.883991 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-b40060b0-c5c2-48c6-af1c-259be07ef04b tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:51:44.884974 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-b40060b0-c5c2-48c6-af1c-259be07ef04b tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] [instance: 90bed19f-dc1d-408e-8520-34e390ac92cd] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:51:44.895878 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-b40060b0-c5c2-48c6-af1c-259be07ef04b tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:51:44.896400 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-b40060b0-c5c2-48c6-af1c-259be07ef04b tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:51:44.902517 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-b40060b0-c5c2-48c6-af1c-259be07ef04b tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:51:44.904046 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-b40060b0-c5c2-48c6-af1c-259be07ef04b tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:51:44.944506 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.wsgi [None req-b40060b0-c5c2-48c6-af1c-259be07ef04b tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] HTTP exception thrown: Instance 90bed19f-dc1d-408e-8520-34e390ac92cd could not be found. Dec 24 10:51:44.945934 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-b40060b0-c5c2-48c6-af1c-259be07ef04b tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] Returning 404 to user: Instance 90bed19f-dc1d-408e-8520-34e390ac92cd could not be found. {{(pid=123432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 24 10:51:44.947115 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-b40060b0-c5c2-48c6-af1c-259be07ef04b tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] 10.222.0.30 "GET /compute/v2.1/servers/90bed19f-dc1d-408e-8520-34e390ac92cd" status: 404 len: 111 microversion: 2.1 time: 0.067444 Dec 24 10:51:44.948212 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 534/1076] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:51:44 2021] GET /compute/v2.1/servers/90bed19f-dc1d-408e-8520-34e390ac92cd => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Dec 24 10:51:45.114259 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-f5af54ae-c3a7-482b-bc6d-70171501bc60 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:51:45.122520 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-f5af54ae-c3a7-482b-bc6d-70171501bc60 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:51:45.124007 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-f5af54ae-c3a7-482b-bc6d-70171501bc60 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:51:45.126330 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-f5af54ae-c3a7-482b-bc6d-70171501bc60 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] 10.222.0.30 "GET /compute/v2.1/servers/d2c0f276-f763-4337-a5dd-0c328c8c2e73" status: 200 len: 1730 microversion: 2.20 time: 0.267560 Dec 24 10:51:45.127369 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 543/1077] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Dec 24 10:51:44 2021] GET /compute/v2.1/servers/d2c0f276-f763-4337-a5dd-0c328c8c2e73 => generated 1730 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 10:51:45.321911 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-c511a863-8d93-4b89-af5c-86c241ab70c3 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:51:45.322853 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-c511a863-8d93-4b89-af5c-86c241ab70c3 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] [instance: 6d8fff5e-934d-469e-8a9b-8457f3a062cf] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:51:45.331141 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-c511a863-8d93-4b89-af5c-86c241ab70c3 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:51:45.331581 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-c511a863-8d93-4b89-af5c-86c241ab70c3 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:51:45.332431 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-c511a863-8d93-4b89-af5c-86c241ab70c3 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:51:45.337358 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-c511a863-8d93-4b89-af5c-86c241ab70c3 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:51:45.445049 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-ec2cb038-ab49-41f3-a33a-97c76783f2e0 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:51:45.446553 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-ec2cb038-ab49-41f3-a33a-97c76783f2e0 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] [instance: 1e267da4-1e48-4136-babc-656ccd50aae2] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:51:45.472232 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-ec2cb038-ab49-41f3-a33a-97c76783f2e0 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:51:45.473672 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-ec2cb038-ab49-41f3-a33a-97c76783f2e0 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:51:45.474805 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-ec2cb038-ab49-41f3-a33a-97c76783f2e0 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:51:45.475566 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-ec2cb038-ab49-41f3-a33a-97c76783f2e0 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:51:45.731908 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-c511a863-8d93-4b89-af5c-86c241ab70c3 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b690a952a1704197baf5e653e27160f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0fd34670674906aa9a61200251b76c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:51:45.759143 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-c511a863-8d93-4b89-af5c-86c241ab70c3 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] 10.222.0.30 "GET /compute/v2.1/servers/6d8fff5e-934d-469e-8a9b-8457f3a062cf" status: 200 len: 1266 microversion: 2.1 time: 0.441482 Dec 24 10:51:45.784992 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 535/1078] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:51:45 2021] GET /compute/v2.1/servers/6d8fff5e-934d-469e-8a9b-8457f3a062cf => generated 1266 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:51:46.147490 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-00ab4329-4bc3-4bd0-8d01-2d5c8dc60dfa tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:51:46.148252 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-00ab4329-4bc3-4bd0-8d01-2d5c8dc60dfa tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] [instance: d2c0f276-f763-4337-a5dd-0c328c8c2e73] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:51:46.158941 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-00ab4329-4bc3-4bd0-8d01-2d5c8dc60dfa tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:51:46.159554 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-00ab4329-4bc3-4bd0-8d01-2d5c8dc60dfa tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:51:46.160666 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-00ab4329-4bc3-4bd0-8d01-2d5c8dc60dfa tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:51:46.161338 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-00ab4329-4bc3-4bd0-8d01-2d5c8dc60dfa tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:51:46.375642 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-00ab4329-4bc3-4bd0-8d01-2d5c8dc60dfa tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:51:46.387537 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-00ab4329-4bc3-4bd0-8d01-2d5c8dc60dfa tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:51:46.389092 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-00ab4329-4bc3-4bd0-8d01-2d5c8dc60dfa tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:51:46.390296 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-00ab4329-4bc3-4bd0-8d01-2d5c8dc60dfa tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] 10.222.0.30 "GET /compute/v2.1/servers/d2c0f276-f763-4337-a5dd-0c328c8c2e73" status: 200 len: 1730 microversion: 2.20 time: 0.246842 Dec 24 10:51:46.393016 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 536/1079] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Dec 24 10:51:46 2021] GET /compute/v2.1/servers/d2c0f276-f763-4337-a5dd-0c328c8c2e73 => generated 1730 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 24 10:51:46.795058 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-29abba02-5262-4345-bd10-9ff318741b80 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:51:46.795687 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-29abba02-5262-4345-bd10-9ff318741b80 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] [instance: 6d8fff5e-934d-469e-8a9b-8457f3a062cf] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:51:46.802687 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-29abba02-5262-4345-bd10-9ff318741b80 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:51:46.803394 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-29abba02-5262-4345-bd10-9ff318741b80 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:51:46.804357 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-29abba02-5262-4345-bd10-9ff318741b80 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:51:46.805283 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-29abba02-5262-4345-bd10-9ff318741b80 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:51:47.051068 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-29abba02-5262-4345-bd10-9ff318741b80 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b690a952a1704197baf5e653e27160f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0fd34670674906aa9a61200251b76c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:51:47.059216 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-29abba02-5262-4345-bd10-9ff318741b80 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] 10.222.0.30 "GET /compute/v2.1/servers/6d8fff5e-934d-469e-8a9b-8457f3a062cf" status: 200 len: 1266 microversion: 2.1 time: 0.270964 Dec 24 10:51:47.071510 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 537/1080] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:51:46 2021] GET /compute/v2.1/servers/6d8fff5e-934d-469e-8a9b-8457f3a062cf => generated 1266 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 24 10:51:47.410485 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-da61fd7f-285f-44c7-8b51-cb02eed7ecd9 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:51:47.411168 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-da61fd7f-285f-44c7-8b51-cb02eed7ecd9 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] [instance: d2c0f276-f763-4337-a5dd-0c328c8c2e73] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:51:47.417657 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-da61fd7f-285f-44c7-8b51-cb02eed7ecd9 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:51:47.418244 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-da61fd7f-285f-44c7-8b51-cb02eed7ecd9 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:51:47.419382 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-da61fd7f-285f-44c7-8b51-cb02eed7ecd9 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:51:47.419972 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-da61fd7f-285f-44c7-8b51-cb02eed7ecd9 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:51:47.620444 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-da61fd7f-285f-44c7-8b51-cb02eed7ecd9 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:51:47.631072 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-da61fd7f-285f-44c7-8b51-cb02eed7ecd9 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:51:47.632912 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-da61fd7f-285f-44c7-8b51-cb02eed7ecd9 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:51:47.634546 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-da61fd7f-285f-44c7-8b51-cb02eed7ecd9 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] 10.222.0.30 "GET /compute/v2.1/servers/d2c0f276-f763-4337-a5dd-0c328c8c2e73" status: 200 len: 1730 microversion: 2.20 time: 0.229705 Dec 24 10:51:47.643881 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 538/1081] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Dec 24 10:51:47 2021] GET /compute/v2.1/servers/d2c0f276-f763-4337-a5dd-0c328c8c2e73 => generated 1730 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 10:51:48.083823 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-8a73901d-18d5-44f6-8eae-87c5ee54f969 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:51:48.084460 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-8a73901d-18d5-44f6-8eae-87c5ee54f969 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] [instance: 6d8fff5e-934d-469e-8a9b-8457f3a062cf] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:51:48.091189 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-8a73901d-18d5-44f6-8eae-87c5ee54f969 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:51:48.091428 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-8a73901d-18d5-44f6-8eae-87c5ee54f969 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:51:48.092081 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-8a73901d-18d5-44f6-8eae-87c5ee54f969 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:51:48.093204 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-8a73901d-18d5-44f6-8eae-87c5ee54f969 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:51:48.395810 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-8a73901d-18d5-44f6-8eae-87c5ee54f969 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b690a952a1704197baf5e653e27160f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0fd34670674906aa9a61200251b76c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:51:48.408227 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-8a73901d-18d5-44f6-8eae-87c5ee54f969 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] 10.222.0.30 "GET /compute/v2.1/servers/6d8fff5e-934d-469e-8a9b-8457f3a062cf" status: 200 len: 1266 microversion: 2.1 time: 0.332356 Dec 24 10:51:48.418866 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 539/1082] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:51:48 2021] GET /compute/v2.1/servers/6d8fff5e-934d-469e-8a9b-8457f3a062cf => generated 1266 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:51:48.654941 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-836011d4-4960-4c9d-a4c2-ce35c1dcee7a tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:51:48.655704 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-836011d4-4960-4c9d-a4c2-ce35c1dcee7a tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] [instance: d2c0f276-f763-4337-a5dd-0c328c8c2e73] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:51:48.667680 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-836011d4-4960-4c9d-a4c2-ce35c1dcee7a tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:51:48.668445 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-836011d4-4960-4c9d-a4c2-ce35c1dcee7a tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:51:48.669306 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-836011d4-4960-4c9d-a4c2-ce35c1dcee7a tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:51:48.669908 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-836011d4-4960-4c9d-a4c2-ce35c1dcee7a tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:51:48.889775 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-836011d4-4960-4c9d-a4c2-ce35c1dcee7a tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:51:48.899636 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-836011d4-4960-4c9d-a4c2-ce35c1dcee7a tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:51:48.901699 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-836011d4-4960-4c9d-a4c2-ce35c1dcee7a tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:51:48.903397 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-836011d4-4960-4c9d-a4c2-ce35c1dcee7a tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] 10.222.0.30 "GET /compute/v2.1/servers/d2c0f276-f763-4337-a5dd-0c328c8c2e73" status: 200 len: 1730 microversion: 2.20 time: 0.252355 Dec 24 10:51:48.904649 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 540/1083] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Dec 24 10:51:48 2021] GET /compute/v2.1/servers/d2c0f276-f763-4337-a5dd-0c328c8c2e73 => generated 1730 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 24 10:51:49.426122 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-04e72812-c329-4033-a252-d01f4e5c2f3a tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:51:49.426823 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-04e72812-c329-4033-a252-d01f4e5c2f3a tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] [instance: 6d8fff5e-934d-469e-8a9b-8457f3a062cf] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:51:49.444231 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-04e72812-c329-4033-a252-d01f4e5c2f3a tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:51:49.444679 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-04e72812-c329-4033-a252-d01f4e5c2f3a tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:51:49.445704 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-04e72812-c329-4033-a252-d01f4e5c2f3a tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:51:49.446140 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-04e72812-c329-4033-a252-d01f4e5c2f3a tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:51:49.585183 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-04e72812-c329-4033-a252-d01f4e5c2f3a tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b690a952a1704197baf5e653e27160f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0fd34670674906aa9a61200251b76c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:51:49.593227 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-04e72812-c329-4033-a252-d01f4e5c2f3a tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] 10.222.0.30 "GET /compute/v2.1/servers/6d8fff5e-934d-469e-8a9b-8457f3a062cf" status: 200 len: 1266 microversion: 2.1 time: 0.170965 Dec 24 10:51:49.593801 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 541/1084] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:51:49 2021] GET /compute/v2.1/servers/6d8fff5e-934d-469e-8a9b-8457f3a062cf => generated 1266 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 24 10:51:49.927829 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-b71b3f52-b292-427a-b71d-51825d4f94c7 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:51:49.927829 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-b71b3f52-b292-427a-b71d-51825d4f94c7 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] [instance: d2c0f276-f763-4337-a5dd-0c328c8c2e73] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:51:49.935233 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-b71b3f52-b292-427a-b71d-51825d4f94c7 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:51:49.935971 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-b71b3f52-b292-427a-b71d-51825d4f94c7 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:51:49.937533 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-b71b3f52-b292-427a-b71d-51825d4f94c7 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:51:49.937998 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-b71b3f52-b292-427a-b71d-51825d4f94c7 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:51:50.177782 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-b71b3f52-b292-427a-b71d-51825d4f94c7 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:51:50.192564 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-b71b3f52-b292-427a-b71d-51825d4f94c7 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:51:50.192564 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-b71b3f52-b292-427a-b71d-51825d4f94c7 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:51:50.192564 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-b71b3f52-b292-427a-b71d-51825d4f94c7 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] 10.222.0.30 "GET /compute/v2.1/servers/d2c0f276-f763-4337-a5dd-0c328c8c2e73" status: 200 len: 1730 microversion: 2.20 time: 0.269718 Dec 24 10:51:50.193167 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 542/1085] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Dec 24 10:51:49 2021] GET /compute/v2.1/servers/d2c0f276-f763-4337-a5dd-0c328c8c2e73 => generated 1730 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 24 10:51:50.610501 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-8190abcf-48b3-4f06-be8d-081669e0b5e7 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:51:50.611129 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-8190abcf-48b3-4f06-be8d-081669e0b5e7 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] [instance: 6d8fff5e-934d-469e-8a9b-8457f3a062cf] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:51:50.619612 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-8190abcf-48b3-4f06-be8d-081669e0b5e7 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:51:50.620058 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-8190abcf-48b3-4f06-be8d-081669e0b5e7 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:51:50.620938 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-8190abcf-48b3-4f06-be8d-081669e0b5e7 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:51:50.621327 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-8190abcf-48b3-4f06-be8d-081669e0b5e7 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:51:50.780864 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-8190abcf-48b3-4f06-be8d-081669e0b5e7 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b690a952a1704197baf5e653e27160f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0fd34670674906aa9a61200251b76c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:51:50.790523 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-8190abcf-48b3-4f06-be8d-081669e0b5e7 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] 10.222.0.30 "GET /compute/v2.1/servers/6d8fff5e-934d-469e-8a9b-8457f3a062cf" status: 200 len: 1266 microversion: 2.1 time: 0.183260 Dec 24 10:51:50.791115 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 543/1086] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:51:50 2021] GET /compute/v2.1/servers/6d8fff5e-934d-469e-8a9b-8457f3a062cf => generated 1266 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 24 10:51:51.209986 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-71142bd7-2323-4c31-8663-ecb72184288a tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:51:51.210617 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-71142bd7-2323-4c31-8663-ecb72184288a tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] [instance: d2c0f276-f763-4337-a5dd-0c328c8c2e73] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:51:51.217829 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-71142bd7-2323-4c31-8663-ecb72184288a tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:51:51.222257 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-71142bd7-2323-4c31-8663-ecb72184288a tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:51:51.230030 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-71142bd7-2323-4c31-8663-ecb72184288a tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:51:51.230030 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-71142bd7-2323-4c31-8663-ecb72184288a tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:51:51.429453 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-71142bd7-2323-4c31-8663-ecb72184288a tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:51:51.452609 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-71142bd7-2323-4c31-8663-ecb72184288a tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:51:51.454240 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-71142bd7-2323-4c31-8663-ecb72184288a tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:51:51.455454 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-71142bd7-2323-4c31-8663-ecb72184288a tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] 10.222.0.30 "GET /compute/v2.1/servers/d2c0f276-f763-4337-a5dd-0c328c8c2e73" status: 200 len: 1730 microversion: 2.20 time: 0.249331 Dec 24 10:51:51.456035 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 544/1087] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Dec 24 10:51:51 2021] GET /compute/v2.1/servers/d2c0f276-f763-4337-a5dd-0c328c8c2e73 => generated 1730 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 24 10:51:51.812528 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-a5ca25bd-5fa2-46f9-992f-1ff73263e8f6 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:51:51.814199 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-a5ca25bd-5fa2-46f9-992f-1ff73263e8f6 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] [instance: 6d8fff5e-934d-469e-8a9b-8457f3a062cf] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:51:51.827667 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-a5ca25bd-5fa2-46f9-992f-1ff73263e8f6 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:51:51.828935 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-a5ca25bd-5fa2-46f9-992f-1ff73263e8f6 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:51:51.830479 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-a5ca25bd-5fa2-46f9-992f-1ff73263e8f6 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:51:51.831456 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-a5ca25bd-5fa2-46f9-992f-1ff73263e8f6 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:51:52.098696 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-a5ca25bd-5fa2-46f9-992f-1ff73263e8f6 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b690a952a1704197baf5e653e27160f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0fd34670674906aa9a61200251b76c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:51:52.107771 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-a5ca25bd-5fa2-46f9-992f-1ff73263e8f6 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] 10.222.0.30 "GET /compute/v2.1/servers/6d8fff5e-934d-469e-8a9b-8457f3a062cf" status: 200 len: 1266 microversion: 2.1 time: 0.300016 Dec 24 10:51:52.121447 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 545/1088] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:51:51 2021] GET /compute/v2.1/servers/6d8fff5e-934d-469e-8a9b-8457f3a062cf => generated 1266 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:51:52.475668 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-92fca4d7-de21-462d-bf00-88e1aca4ede5 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:51:52.477052 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-92fca4d7-de21-462d-bf00-88e1aca4ede5 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] [instance: d2c0f276-f763-4337-a5dd-0c328c8c2e73] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:51:52.488853 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-92fca4d7-de21-462d-bf00-88e1aca4ede5 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:51:52.495700 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-92fca4d7-de21-462d-bf00-88e1aca4ede5 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:51:52.500075 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-92fca4d7-de21-462d-bf00-88e1aca4ede5 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:51:52.502153 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-92fca4d7-de21-462d-bf00-88e1aca4ede5 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:51:52.717854 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-92fca4d7-de21-462d-bf00-88e1aca4ede5 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:51:52.727269 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-92fca4d7-de21-462d-bf00-88e1aca4ede5 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:51:52.729723 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-92fca4d7-de21-462d-bf00-88e1aca4ede5 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:51:52.731480 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-92fca4d7-de21-462d-bf00-88e1aca4ede5 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] 10.222.0.30 "GET /compute/v2.1/servers/d2c0f276-f763-4337-a5dd-0c328c8c2e73" status: 200 len: 1730 microversion: 2.20 time: 0.259830 Dec 24 10:51:52.744663 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 546/1089] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Dec 24 10:51:52 2021] GET /compute/v2.1/servers/d2c0f276-f763-4337-a5dd-0c328c8c2e73 => generated 1730 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 10:51:53.124472 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-60dfe135-1774-4ce7-9143-378ee200b0f5 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:51:53.126104 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-60dfe135-1774-4ce7-9143-378ee200b0f5 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] [instance: 6d8fff5e-934d-469e-8a9b-8457f3a062cf] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:51:53.134996 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-60dfe135-1774-4ce7-9143-378ee200b0f5 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:51:53.134996 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-60dfe135-1774-4ce7-9143-378ee200b0f5 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:51:53.135321 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-60dfe135-1774-4ce7-9143-378ee200b0f5 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:51:53.135850 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-60dfe135-1774-4ce7-9143-378ee200b0f5 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:51:53.389128 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-60dfe135-1774-4ce7-9143-378ee200b0f5 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b690a952a1704197baf5e653e27160f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0fd34670674906aa9a61200251b76c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:51:53.401199 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-60dfe135-1774-4ce7-9143-378ee200b0f5 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] 10.222.0.30 "GET /compute/v2.1/servers/6d8fff5e-934d-469e-8a9b-8457f3a062cf" status: 200 len: 1266 microversion: 2.1 time: 0.280798 Dec 24 10:51:53.403869 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 547/1090] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:51:53 2021] GET /compute/v2.1/servers/6d8fff5e-934d-469e-8a9b-8457f3a062cf => generated 1266 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:51:53.753847 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-8f370dde-9864-4d47-a4e4-9bf52864e007 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:51:53.753847 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-8f370dde-9864-4d47-a4e4-9bf52864e007 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] [instance: d2c0f276-f763-4337-a5dd-0c328c8c2e73] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:51:53.763556 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-8f370dde-9864-4d47-a4e4-9bf52864e007 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:51:53.764105 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-8f370dde-9864-4d47-a4e4-9bf52864e007 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:51:53.765011 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-8f370dde-9864-4d47-a4e4-9bf52864e007 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:51:53.765513 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-8f370dde-9864-4d47-a4e4-9bf52864e007 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:51:53.970327 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-8f370dde-9864-4d47-a4e4-9bf52864e007 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:51:53.981882 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-8f370dde-9864-4d47-a4e4-9bf52864e007 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:51:53.983404 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-8f370dde-9864-4d47-a4e4-9bf52864e007 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:51:53.984582 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-8f370dde-9864-4d47-a4e4-9bf52864e007 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] 10.222.0.30 "GET /compute/v2.1/servers/d2c0f276-f763-4337-a5dd-0c328c8c2e73" status: 200 len: 1730 microversion: 2.20 time: 0.237988 Dec 24 10:51:53.994484 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 548/1091] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Dec 24 10:51:53 2021] GET /compute/v2.1/servers/d2c0f276-f763-4337-a5dd-0c328c8c2e73 => generated 1730 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 24 10:51:54.422670 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-98fa3a0d-c8ed-4e9d-a7d6-9407b6a60f95 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:51:54.423322 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-98fa3a0d-c8ed-4e9d-a7d6-9407b6a60f95 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] [instance: 6d8fff5e-934d-469e-8a9b-8457f3a062cf] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:51:54.431056 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-98fa3a0d-c8ed-4e9d-a7d6-9407b6a60f95 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:51:54.432075 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-98fa3a0d-c8ed-4e9d-a7d6-9407b6a60f95 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:51:54.433115 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-98fa3a0d-c8ed-4e9d-a7d6-9407b6a60f95 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:51:54.433796 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-98fa3a0d-c8ed-4e9d-a7d6-9407b6a60f95 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:51:54.656076 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-98fa3a0d-c8ed-4e9d-a7d6-9407b6a60f95 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b690a952a1704197baf5e653e27160f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0fd34670674906aa9a61200251b76c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:51:54.666039 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-98fa3a0d-c8ed-4e9d-a7d6-9407b6a60f95 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] 10.222.0.30 "GET /compute/v2.1/servers/6d8fff5e-934d-469e-8a9b-8457f3a062cf" status: 200 len: 1266 microversion: 2.1 time: 0.246750 Dec 24 10:51:54.666883 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 549/1092] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:51:54 2021] GET /compute/v2.1/servers/6d8fff5e-934d-469e-8a9b-8457f3a062cf => generated 1266 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 24 10:51:55.002888 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-5851f92c-6c94-4942-95cf-8036ac41be1d tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:51:55.003794 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-5851f92c-6c94-4942-95cf-8036ac41be1d tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] [instance: d2c0f276-f763-4337-a5dd-0c328c8c2e73] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:51:55.010999 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-5851f92c-6c94-4942-95cf-8036ac41be1d tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:51:55.011732 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-5851f92c-6c94-4942-95cf-8036ac41be1d tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:51:55.013214 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-5851f92c-6c94-4942-95cf-8036ac41be1d tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:51:55.013793 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-5851f92c-6c94-4942-95cf-8036ac41be1d tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:51:55.177232 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-5851f92c-6c94-4942-95cf-8036ac41be1d tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:51:55.185283 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-5851f92c-6c94-4942-95cf-8036ac41be1d tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:51:55.186850 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-5851f92c-6c94-4942-95cf-8036ac41be1d tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:51:55.188089 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-5851f92c-6c94-4942-95cf-8036ac41be1d tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] 10.222.0.30 "GET /compute/v2.1/servers/d2c0f276-f763-4337-a5dd-0c328c8c2e73" status: 200 len: 1730 microversion: 2.20 time: 0.189079 Dec 24 10:51:55.188741 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 550/1093] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Dec 24 10:51:54 2021] GET /compute/v2.1/servers/d2c0f276-f763-4337-a5dd-0c328c8c2e73 => generated 1730 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 10:51:55.563696 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-ec2cb038-ab49-41f3-a33a-97c76783f2e0 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] 10.222.0.30 "POST /compute/v2.1/servers/1e267da4-1e48-4136-babc-656ccd50aae2/action" status: 200 len: 38298 microversion: 2.1 time: 10.122766 Dec 24 10:51:55.564366 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 544/1094] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Dec 24 10:51:45 2021] POST /compute/v2.1/servers/1e267da4-1e48-4136-babc-656ccd50aae2/action => generated 38298 bytes in 10124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 24 10:51:55.574918 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-6e277fa4-6a78-4c2d-b1b4-78e076f6546f tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:51:55.575420 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-6e277fa4-6a78-4c2d-b1b4-78e076f6546f tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] [instance: 1e267da4-1e48-4136-babc-656ccd50aae2] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:51:55.582660 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-6e277fa4-6a78-4c2d-b1b4-78e076f6546f tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:51:55.583116 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-6e277fa4-6a78-4c2d-b1b4-78e076f6546f tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:51:55.583949 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-6e277fa4-6a78-4c2d-b1b4-78e076f6546f tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:51:55.584414 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-6e277fa4-6a78-4c2d-b1b4-78e076f6546f tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:51:55.614108 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-6e277fa4-6a78-4c2d-b1b4-78e076f6546f tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] 10.222.0.30 "GET /compute/v2.1/servers/1e267da4-1e48-4136-babc-656ccd50aae2/ips" status: 200 len: 145 microversion: 2.1 time: 0.043525 Dec 24 10:51:55.614751 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 551/1095] 10.222.0.30 () {58 vars in 1247 bytes} [Fri Dec 24 10:51:55 2021] GET /compute/v2.1/servers/1e267da4-1e48-4136-babc-656ccd50aae2/ips => generated 145 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 10:51:55.683790 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-f9675e93-4158-4124-9137-f9408a9816a1 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:51:55.684486 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-f9675e93-4158-4124-9137-f9408a9816a1 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] [instance: 6d8fff5e-934d-469e-8a9b-8457f3a062cf] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:51:55.691563 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-f9675e93-4158-4124-9137-f9408a9816a1 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:51:55.692247 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-f9675e93-4158-4124-9137-f9408a9816a1 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:51:55.693354 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-f9675e93-4158-4124-9137-f9408a9816a1 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:51:55.693951 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-f9675e93-4158-4124-9137-f9408a9816a1 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:51:55.836562 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-f9675e93-4158-4124-9137-f9408a9816a1 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b690a952a1704197baf5e653e27160f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0fd34670674906aa9a61200251b76c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:51:55.844575 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-f9675e93-4158-4124-9137-f9408a9816a1 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] 10.222.0.30 "GET /compute/v2.1/servers/6d8fff5e-934d-469e-8a9b-8457f3a062cf" status: 200 len: 1266 microversion: 2.1 time: 0.165441 Dec 24 10:51:55.848230 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 545/1096] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:51:55 2021] GET /compute/v2.1/servers/6d8fff5e-934d-469e-8a9b-8457f3a062cf => generated 1266 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:51:56.191909 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-9c2ee705-360e-4bba-9118-e25d9b1ffaf0 tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-930471874", "imageRef": "fae8172d-77c4-4f40-905a-7285c185448c", "flavorRef": "452", "networks": [{"uuid": "d6398a4c-0879-44d1-a22a-b560c11704a8"}]}} {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:51:56.206460 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-4def278c-5f4d-4a6e-9db0-13d1febba2a4 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:51:56.223132 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-4def278c-5f4d-4a6e-9db0-13d1febba2a4 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] [instance: d2c0f276-f763-4337-a5dd-0c328c8c2e73] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:51:56.223132 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-4def278c-5f4d-4a6e-9db0-13d1febba2a4 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:51:56.223132 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-4def278c-5f4d-4a6e-9db0-13d1febba2a4 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:51:56.223132 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-4def278c-5f4d-4a6e-9db0-13d1febba2a4 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:51:56.223711 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-4def278c-5f4d-4a6e-9db0-13d1febba2a4 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:51:56.271916 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.network.neutron [None req-9c2ee705-360e-4bba-9118-e25d9b1ffaf0 tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] validate_networks() for [('d6398a4c-0879-44d1-a22a-b560c11704a8', None, None, None, None, None)] {{(pid=123432) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 24 10:51:56.410784 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-4def278c-5f4d-4a6e-9db0-13d1febba2a4 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:51:56.418566 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-4def278c-5f4d-4a6e-9db0-13d1febba2a4 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:51:56.421664 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-4def278c-5f4d-4a6e-9db0-13d1febba2a4 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:51:56.423052 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-4def278c-5f4d-4a6e-9db0-13d1febba2a4 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] 10.222.0.30 "GET /compute/v2.1/servers/d2c0f276-f763-4337-a5dd-0c328c8c2e73" status: 200 len: 1730 microversion: 2.20 time: 0.220923 Dec 24 10:51:56.424140 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 546/1097] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Dec 24 10:51:56 2021] GET /compute/v2.1/servers/d2c0f276-f763-4337-a5dd-0c328c8c2e73 => generated 1730 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 10:51:56.865152 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-e13acd45-496b-476c-bacf-0d46e575abcf tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:51:56.866477 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-e13acd45-496b-476c-bacf-0d46e575abcf tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] [instance: 6d8fff5e-934d-469e-8a9b-8457f3a062cf] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:51:56.873347 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-e13acd45-496b-476c-bacf-0d46e575abcf tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:51:56.873785 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-e13acd45-496b-476c-bacf-0d46e575abcf tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:51:56.874784 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-e13acd45-496b-476c-bacf-0d46e575abcf tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:51:56.875395 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-e13acd45-496b-476c-bacf-0d46e575abcf tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:51:57.048885 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-e13acd45-496b-476c-bacf-0d46e575abcf tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b690a952a1704197baf5e653e27160f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0fd34670674906aa9a61200251b76c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:51:57.061909 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-e13acd45-496b-476c-bacf-0d46e575abcf tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] 10.222.0.30 "GET /compute/v2.1/servers/6d8fff5e-934d-469e-8a9b-8457f3a062cf" status: 200 len: 1453 microversion: 2.1 time: 0.200294 Dec 24 10:51:57.062499 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 547/1098] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:51:56 2021] GET /compute/v2.1/servers/6d8fff5e-934d-469e-8a9b-8457f3a062cf => generated 1453 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 24 10:51:57.081196 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-cd33b3f8-8fb0-48a5-a7f1-0dad0f7ed72f tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:51:57.081805 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-cd33b3f8-8fb0-48a5-a7f1-0dad0f7ed72f tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] [instance: 6d8fff5e-934d-469e-8a9b-8457f3a062cf] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:51:57.095245 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-cd33b3f8-8fb0-48a5-a7f1-0dad0f7ed72f tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:51:57.098977 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-cd33b3f8-8fb0-48a5-a7f1-0dad0f7ed72f tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:51:57.099818 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-cd33b3f8-8fb0-48a5-a7f1-0dad0f7ed72f tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:51:57.100253 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-cd33b3f8-8fb0-48a5-a7f1-0dad0f7ed72f tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:51:57.222703 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.virt.hardware [None req-9c2ee705-360e-4bba-9118-e25d9b1ffaf0 tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] Flavor limits 0:0:0 {{(pid=123432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 24 10:51:57.223666 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.virt.hardware [None req-9c2ee705-360e-4bba-9118-e25d9b1ffaf0 tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] Image limits 0:0:0 {{(pid=123432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 24 10:51:57.224231 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.virt.hardware [None req-9c2ee705-360e-4bba-9118-e25d9b1ffaf0 tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] Flavor pref 0:0:0 {{(pid=123432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 24 10:51:57.224648 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.virt.hardware [None req-9c2ee705-360e-4bba-9118-e25d9b1ffaf0 tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] Image pref 0:0:0 {{(pid=123432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 24 10:51:57.225078 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.virt.hardware [None req-9c2ee705-360e-4bba-9118-e25d9b1ffaf0 tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 24 10:51:57.235956 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-9c2ee705-360e-4bba-9118-e25d9b1ffaf0 tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:51:57.236690 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-9c2ee705-360e-4bba-9118-e25d9b1ffaf0 tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:51:57.237687 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-9c2ee705-360e-4bba-9118-e25d9b1ffaf0 tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:51:57.238295 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-9c2ee705-360e-4bba-9118-e25d9b1ffaf0 tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:51:57.257927 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.quota [None req-9c2ee705-360e-4bba-9118-e25d9b1ffaf0 tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] Getting quotas for project 696f3d18f3af4e0eb5760d829e0c3977. Resources: {'instances', 'cores', 'ram'} {{(pid=123432) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 24 10:51:57.263962 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.quota [None req-9c2ee705-360e-4bba-9118-e25d9b1ffaf0 tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] Getting quotas for user edc441b6f06b44beb2a85f854cf92dd3 and project 696f3d18f3af4e0eb5760d829e0c3977. Resources: {'instances', 'cores', 'ram'} {{(pid=123432) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 24 10:51:57.271003 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-cd33b3f8-8fb0-48a5-a7f1-0dad0f7ed72f tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b690a952a1704197baf5e653e27160f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0fd34670674906aa9a61200251b76c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:51:57.281779 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-9c2ee705-360e-4bba-9118-e25d9b1ffaf0 tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] Going to run 1 instances... {{(pid=123432) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 24 10:51:57.283042 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-cd33b3f8-8fb0-48a5-a7f1-0dad0f7ed72f tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] 10.222.0.30 "GET /compute/v2.1/servers/6d8fff5e-934d-469e-8a9b-8457f3a062cf" status: 200 len: 1453 microversion: 2.1 time: 0.205394 Dec 24 10:51:57.284317 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 548/1099] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:51:57 2021] GET /compute/v2.1/servers/6d8fff5e-934d-469e-8a9b-8457f3a062cf => generated 1453 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 24 10:51:57.291487 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-9c2ee705-360e-4bba-9118-e25d9b1ffaf0 tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] [instance: 8f5b5fe7-eb9b-4c53-a76a-ea25e7910dd0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fae8172d-77c4-4f40-905a-7285c185448c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123432) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 24 10:51:57.445743 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-124a6f1f-deac-4c4b-a2e4-9dc2d2459263 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:51:57.447231 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-124a6f1f-deac-4c4b-a2e4-9dc2d2459263 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] [instance: d2c0f276-f763-4337-a5dd-0c328c8c2e73] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:51:57.465044 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-124a6f1f-deac-4c4b-a2e4-9dc2d2459263 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:51:57.466438 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-124a6f1f-deac-4c4b-a2e4-9dc2d2459263 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:51:57.467468 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-124a6f1f-deac-4c4b-a2e4-9dc2d2459263 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:51:57.469611 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-9c2ee705-360e-4bba-9118-e25d9b1ffaf0 tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.281443 Dec 24 10:51:57.470407 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-124a6f1f-deac-4c4b-a2e4-9dc2d2459263 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:51:57.472789 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 552/1100] 10.222.0.30 () {60 vars in 1146 bytes} [Fri Dec 24 10:51:56 2021] POST /compute/v2.1/servers => generated 380 bytes in 1285 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 24 10:51:57.490275 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-ce1df188-fe22-4962-94ff-4d3daf6a1b36 tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:51:57.491126 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-ce1df188-fe22-4962-94ff-4d3daf6a1b36 tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] [instance: 8f5b5fe7-eb9b-4c53-a76a-ea25e7910dd0] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:51:57.629246 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-ce1df188-fe22-4962-94ff-4d3daf6a1b36 tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc441b6f06b44beb2a85f854cf92dd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696f3d18f3af4e0eb5760d829e0c3977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:51:57.639434 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-ce1df188-fe22-4962-94ff-4d3daf6a1b36 tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] 10.222.0.30 "GET /compute/v2.1/servers/8f5b5fe7-eb9b-4c53-a76a-ea25e7910dd0" status: 200 len: 1218 microversion: 2.1 time: 0.159963 Dec 24 10:51:57.640186 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 553/1101] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:51:57 2021] GET /compute/v2.1/servers/8f5b5fe7-eb9b-4c53-a76a-ea25e7910dd0 => generated 1218 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 24 10:51:57.654794 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-7a33c596-7a26-4939-ad36-459d275f4ca7 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f560cf3a-ef73-4da8-9ff1-5ad327c84be2"}} {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:51:57.654794 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-7a33c596-7a26-4939-ad36-459d275f4ca7 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] [instance: 1e267da4-1e48-4136-babc-656ccd50aae2] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:51:57.667306 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-7a33c596-7a26-4939-ad36-459d275f4ca7 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:51:57.668044 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-7a33c596-7a26-4939-ad36-459d275f4ca7 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:51:57.668998 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-7a33c596-7a26-4939-ad36-459d275f4ca7 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:51:57.669524 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-7a33c596-7a26-4939-ad36-459d275f4ca7 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:51:57.693407 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-124a6f1f-deac-4c4b-a2e4-9dc2d2459263 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:51:57.701608 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-124a6f1f-deac-4c4b-a2e4-9dc2d2459263 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:51:57.706998 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-124a6f1f-deac-4c4b-a2e4-9dc2d2459263 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:51:57.708477 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-124a6f1f-deac-4c4b-a2e4-9dc2d2459263 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] 10.222.0.30 "GET /compute/v2.1/servers/d2c0f276-f763-4337-a5dd-0c328c8c2e73" status: 200 len: 1730 microversion: 2.20 time: 0.270157 Dec 24 10:51:57.709853 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 549/1102] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Dec 24 10:51:57 2021] GET /compute/v2.1/servers/d2c0f276-f763-4337-a5dd-0c328c8c2e73 => generated 1730 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 10:51:58.661829 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-3251fd29-7f29-4bc0-a2fb-2896633d76f7 tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:51:58.668467 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-3251fd29-7f29-4bc0-a2fb-2896633d76f7 tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] [instance: 8f5b5fe7-eb9b-4c53-a76a-ea25e7910dd0] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:51:58.672758 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-3251fd29-7f29-4bc0-a2fb-2896633d76f7 tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:51:58.673272 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-3251fd29-7f29-4bc0-a2fb-2896633d76f7 tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:51:58.674114 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-3251fd29-7f29-4bc0-a2fb-2896633d76f7 tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:51:58.674558 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-3251fd29-7f29-4bc0-a2fb-2896633d76f7 tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:51:58.738786 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-3251fd29-7f29-4bc0-a2fb-2896633d76f7 tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc441b6f06b44beb2a85f854cf92dd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696f3d18f3af4e0eb5760d829e0c3977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:51:58.747423 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-3251fd29-7f29-4bc0-a2fb-2896633d76f7 tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] 10.222.0.30 "GET /compute/v2.1/servers/8f5b5fe7-eb9b-4c53-a76a-ea25e7910dd0" status: 200 len: 1222 microversion: 2.1 time: 0.089093 Dec 24 10:51:58.748294 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 550/1103] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:51:58 2021] GET /compute/v2.1/servers/8f5b5fe7-eb9b-4c53-a76a-ea25e7910dd0 => generated 1222 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 24 10:51:58.759599 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-7fe5ec15-43a6-448a-9f22-6f41eed9ce1e tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:51:58.760389 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-7fe5ec15-43a6-448a-9f22-6f41eed9ce1e tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] [instance: d2c0f276-f763-4337-a5dd-0c328c8c2e73] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:51:58.767278 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-7fe5ec15-43a6-448a-9f22-6f41eed9ce1e tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:51:58.767732 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-7fe5ec15-43a6-448a-9f22-6f41eed9ce1e tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:51:58.768556 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-7fe5ec15-43a6-448a-9f22-6f41eed9ce1e tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:51:58.769020 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-7fe5ec15-43a6-448a-9f22-6f41eed9ce1e tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:51:58.822549 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-7a33c596-7a26-4939-ad36-459d275f4ca7 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] 10.222.0.30 "POST /compute/v2.1/servers/1e267da4-1e48-4136-babc-656ccd50aae2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.162894 Dec 24 10:51:58.828918 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 554/1104] 10.222.0.30 () {60 vars in 1322 bytes} [Fri Dec 24 10:51:57 2021] POST /compute/v2.1/servers/1e267da4-1e48-4136-babc-656ccd50aae2/os-volume_attachments => generated 194 bytes in 1186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 10:51:58.948581 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-7fe5ec15-43a6-448a-9f22-6f41eed9ce1e tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:51:58.956965 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-7fe5ec15-43a6-448a-9f22-6f41eed9ce1e tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:51:58.959675 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-7fe5ec15-43a6-448a-9f22-6f41eed9ce1e tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:51:58.961277 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-7fe5ec15-43a6-448a-9f22-6f41eed9ce1e tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] 10.222.0.30 "GET /compute/v2.1/servers/d2c0f276-f763-4337-a5dd-0c328c8c2e73" status: 200 len: 1730 microversion: 2.20 time: 0.211621 Dec 24 10:51:58.969002 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 551/1105] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Dec 24 10:51:58 2021] GET /compute/v2.1/servers/d2c0f276-f763-4337-a5dd-0c328c8c2e73 => generated 1730 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 10:51:59.547207 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [req-fea5be95-4a56-4ede-b416-5e9303c302b0 req-00c4b856-fdbd-48a9-b115-f6b54412670e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2c0f276-f763-4337-a5dd-0c328c8c2e73", "name": "network-vif-plugged", "status": "completed", "tag": "4043d4f5-4811-4ba4-8723-4f04e5548d1c"}]} {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:51:59.550918 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 10:51:59.550918 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: warnings.warn(msg) Dec 24 10:51:59.562552 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [req-fea5be95-4a56-4ede-b416-5e9303c302b0 req-00c4b856-fdbd-48a9-b115-f6b54412670e service nova] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:51:59.563078 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [req-fea5be95-4a56-4ede-b416-5e9303c302b0 req-00c4b856-fdbd-48a9-b115-f6b54412670e service nova] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:51:59.588752 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.compute.server_external_events [req-fea5be95-4a56-4ede-b416-5e9303c302b0 req-00c4b856-fdbd-48a9-b115-f6b54412670e service nova] Creating event network-vif-plugged:4043d4f5-4811-4ba4-8723-4f04e5548d1c for instance d2c0f276-f763-4337-a5dd-0c328c8c2e73 on hv-cinder-81644 Dec 24 10:51:59.600377 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [req-fea5be95-4a56-4ede-b416-5e9303c302b0 req-00c4b856-fdbd-48a9-b115-f6b54412670e service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059616 Dec 24 10:51:59.601346 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 552/1106] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Dec 24 10:51:59 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 10:51:59.681739 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-8e7ced0c-6caf-405a-bf3a-9c0affc392f6 tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Action: 'create', calling method: .version_select at 0x7f1899a03550>, body: {"keypair": {"name": "tempest-TestShelveInstance-546307184"}} {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:51:59.699389 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.quota [None req-8e7ced0c-6caf-405a-bf3a-9c0affc392f6 tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Getting quotas for project 9abda8fd8574437e892913c775910de0. Resources: {'key_pairs'} {{(pid=123432) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 24 10:51:59.704004 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.quota [None req-8e7ced0c-6caf-405a-bf3a-9c0affc392f6 tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Getting quotas for user f366d62f6b3f4a0487d37e765a3fad02 and project 9abda8fd8574437e892913c775910de0. Resources: {'key_pairs'} {{(pid=123432) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 24 10:51:59.767042 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-2a0c29c5-ba36-4a6f-bc7f-2bb1383fbd58 tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:51:59.768353 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-2a0c29c5-ba36-4a6f-bc7f-2bb1383fbd58 tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] [instance: 8f5b5fe7-eb9b-4c53-a76a-ea25e7910dd0] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:51:59.782670 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-2a0c29c5-ba36-4a6f-bc7f-2bb1383fbd58 tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:51:59.795196 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-2a0c29c5-ba36-4a6f-bc7f-2bb1383fbd58 tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:51:59.796337 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-2a0c29c5-ba36-4a6f-bc7f-2bb1383fbd58 tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:51:59.797740 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-2a0c29c5-ba36-4a6f-bc7f-2bb1383fbd58 tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:51:59.884136 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-2a0c29c5-ba36-4a6f-bc7f-2bb1383fbd58 tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc441b6f06b44beb2a85f854cf92dd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696f3d18f3af4e0eb5760d829e0c3977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:51:59.895865 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-2a0c29c5-ba36-4a6f-bc7f-2bb1383fbd58 tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] 10.222.0.30 "GET /compute/v2.1/servers/8f5b5fe7-eb9b-4c53-a76a-ea25e7910dd0" status: 200 len: 1270 microversion: 2.1 time: 0.131674 Dec 24 10:51:59.897008 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 553/1107] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:51:59 2021] GET /compute/v2.1/servers/8f5b5fe7-eb9b-4c53-a76a-ea25e7910dd0 => generated 1270 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:51:59.979759 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-1d2fafb5-1fe6-4953-b56c-1a832d0a912f tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:51:59.980356 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-1d2fafb5-1fe6-4953-b56c-1a832d0a912f tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] [instance: d2c0f276-f763-4337-a5dd-0c328c8c2e73] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:51:59.991010 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-1d2fafb5-1fe6-4953-b56c-1a832d0a912f tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:51:59.991452 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-1d2fafb5-1fe6-4953-b56c-1a832d0a912f tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:51:59.992310 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-1d2fafb5-1fe6-4953-b56c-1a832d0a912f tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:51:59.992740 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-1d2fafb5-1fe6-4953-b56c-1a832d0a912f tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:52:00.081408 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.quota [None req-8e7ced0c-6caf-405a-bf3a-9c0affc392f6 tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Getting quotas for project 9abda8fd8574437e892913c775910de0. Resources: {'key_pairs'} {{(pid=123432) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 24 10:52:00.085479 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.quota [None req-8e7ced0c-6caf-405a-bf3a-9c0affc392f6 tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Getting quotas for user f366d62f6b3f4a0487d37e765a3fad02 and project 9abda8fd8574437e892913c775910de0. Resources: {'key_pairs'} {{(pid=123432) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 24 10:52:00.099737 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-8e7ced0c-6caf-405a-bf3a-9c0affc392f6 tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 2315 microversion: 2.1 time: 0.615592 Dec 24 10:52:00.100571 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 555/1108] 10.222.0.30 () {60 vars in 1157 bytes} [Fri Dec 24 10:51:59 2021] POST /compute/v2.1/os-keypairs => generated 2315 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:52:00.177972 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-1d2fafb5-1fe6-4953-b56c-1a832d0a912f tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:52:00.186333 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-1d2fafb5-1fe6-4953-b56c-1a832d0a912f tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:52:00.187820 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-1d2fafb5-1fe6-4953-b56c-1a832d0a912f tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:52:00.189800 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-1d2fafb5-1fe6-4953-b56c-1a832d0a912f tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] 10.222.0.30 "GET /compute/v2.1/servers/d2c0f276-f763-4337-a5dd-0c328c8c2e73" status: 200 len: 1730 microversion: 2.20 time: 0.213599 Dec 24 10:52:00.189800 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 554/1109] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Dec 24 10:51:59 2021] GET /compute/v2.1/servers/d2c0f276-f763-4337-a5dd-0c328c8c2e73 => generated 1730 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 10:52:00.913174 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-ae4652af-96e9-4490-95f5-b51ef0971bf9 tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:52:00.918747 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-ae4652af-96e9-4490-95f5-b51ef0971bf9 tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] [instance: 8f5b5fe7-eb9b-4c53-a76a-ea25e7910dd0] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:52:00.927811 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [req-96847a23-e0c9-46d3-a024-3a3be466d800 req-2f524054-a282-48c3-acb1-b3677cbc3b81 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6d8fff5e-934d-469e-8a9b-8457f3a062cf", "tag": "1d65157c-7f7f-44f7-86a3-f01fae63875b"}]} {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:52:00.929320 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 10:52:00.929320 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: warnings.warn(msg) Dec 24 10:52:00.937518 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-ae4652af-96e9-4490-95f5-b51ef0971bf9 tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:52:00.939754 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-ae4652af-96e9-4490-95f5-b51ef0971bf9 tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:52:00.947615 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-ae4652af-96e9-4490-95f5-b51ef0971bf9 tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:52:00.947615 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-ae4652af-96e9-4490-95f5-b51ef0971bf9 tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:52:00.949540 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [req-96847a23-e0c9-46d3-a024-3a3be466d800 req-2f524054-a282-48c3-acb1-b3677cbc3b81 service nova] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:52:00.960511 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [req-96847a23-e0c9-46d3-a024-3a3be466d800 req-2f524054-a282-48c3-acb1-b3677cbc3b81 service nova] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:52:00.979271 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.compute.server_external_events [req-96847a23-e0c9-46d3-a024-3a3be466d800 req-2f524054-a282-48c3-acb1-b3677cbc3b81 service nova] Creating event network-changed:1d65157c-7f7f-44f7-86a3-f01fae63875b for instance 6d8fff5e-934d-469e-8a9b-8457f3a062cf on hv-cinder-81644 Dec 24 10:52:00.995508 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [req-96847a23-e0c9-46d3-a024-3a3be466d800 req-2f524054-a282-48c3-acb1-b3677cbc3b81 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070103 Dec 24 10:52:00.996284 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 555/1110] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Dec 24 10:52:00 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 10:52:01.011286 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-ae4652af-96e9-4490-95f5-b51ef0971bf9 tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc441b6f06b44beb2a85f854cf92dd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696f3d18f3af4e0eb5760d829e0c3977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:52:01.020899 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-ae4652af-96e9-4490-95f5-b51ef0971bf9 tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] 10.222.0.30 "GET /compute/v2.1/servers/8f5b5fe7-eb9b-4c53-a76a-ea25e7910dd0" status: 200 len: 1276 microversion: 2.1 time: 0.111597 Dec 24 10:52:01.023753 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 556/1111] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:52:00 2021] GET /compute/v2.1/servers/8f5b5fe7-eb9b-4c53-a76a-ea25e7910dd0 => generated 1276 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:52:01.209614 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-8532bc4b-f976-4020-ba52-7b9519eb438c tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:52:01.210745 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-8532bc4b-f976-4020-ba52-7b9519eb438c tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] [instance: d2c0f276-f763-4337-a5dd-0c328c8c2e73] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:52:01.217556 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-8532bc4b-f976-4020-ba52-7b9519eb438c tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:52:01.218426 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-8532bc4b-f976-4020-ba52-7b9519eb438c tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:52:01.219407 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-8532bc4b-f976-4020-ba52-7b9519eb438c tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:52:01.219844 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-8532bc4b-f976-4020-ba52-7b9519eb438c tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:52:01.523145 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-8532bc4b-f976-4020-ba52-7b9519eb438c tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:52:01.544696 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-8532bc4b-f976-4020-ba52-7b9519eb438c tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:52:01.548635 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-8532bc4b-f976-4020-ba52-7b9519eb438c tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:52:01.548635 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-8532bc4b-f976-4020-ba52-7b9519eb438c tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] 10.222.0.30 "GET /compute/v2.1/servers/d2c0f276-f763-4337-a5dd-0c328c8c2e73" status: 200 len: 1730 microversion: 2.20 time: 0.343077 Dec 24 10:52:01.550257 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 556/1112] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Dec 24 10:52:01 2021] GET /compute/v2.1/servers/d2c0f276-f763-4337-a5dd-0c328c8c2e73 => generated 1730 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 24 10:52:02.040003 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-731822b6-2c6c-4f74-978a-1765bf852d46 tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:52:02.040727 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-731822b6-2c6c-4f74-978a-1765bf852d46 tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] [instance: 8f5b5fe7-eb9b-4c53-a76a-ea25e7910dd0] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:52:02.057406 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-731822b6-2c6c-4f74-978a-1765bf852d46 tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:52:02.058010 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-731822b6-2c6c-4f74-978a-1765bf852d46 tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:52:02.058984 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-731822b6-2c6c-4f74-978a-1765bf852d46 tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:52:02.059674 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-731822b6-2c6c-4f74-978a-1765bf852d46 tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:52:02.314380 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-731822b6-2c6c-4f74-978a-1765bf852d46 tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc441b6f06b44beb2a85f854cf92dd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696f3d18f3af4e0eb5760d829e0c3977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:52:02.321985 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-731822b6-2c6c-4f74-978a-1765bf852d46 tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] 10.222.0.30 "GET /compute/v2.1/servers/8f5b5fe7-eb9b-4c53-a76a-ea25e7910dd0" status: 200 len: 1318 microversion: 2.1 time: 0.286296 Dec 24 10:52:02.322902 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 557/1113] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:52:02 2021] GET /compute/v2.1/servers/8f5b5fe7-eb9b-4c53-a76a-ea25e7910dd0 => generated 1318 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:52:02.568172 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-ebf69e11-ae22-46e0-a97f-d5e44d10f179 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:52:02.571539 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-ebf69e11-ae22-46e0-a97f-d5e44d10f179 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] [instance: d2c0f276-f763-4337-a5dd-0c328c8c2e73] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:52:02.598951 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-ebf69e11-ae22-46e0-a97f-d5e44d10f179 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:52:02.599624 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-ebf69e11-ae22-46e0-a97f-d5e44d10f179 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:52:02.616674 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-ebf69e11-ae22-46e0-a97f-d5e44d10f179 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:52:02.616674 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-ebf69e11-ae22-46e0-a97f-d5e44d10f179 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:52:03.120977 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-ebf69e11-ae22-46e0-a97f-d5e44d10f179 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:52:03.130093 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-ebf69e11-ae22-46e0-a97f-d5e44d10f179 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:52:03.131989 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-ebf69e11-ae22-46e0-a97f-d5e44d10f179 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:52:03.133740 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-ebf69e11-ae22-46e0-a97f-d5e44d10f179 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] 10.222.0.30 "GET /compute/v2.1/servers/d2c0f276-f763-4337-a5dd-0c328c8c2e73" status: 200 len: 1730 microversion: 2.20 time: 0.570157 Dec 24 10:52:03.134316 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 557/1114] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Dec 24 10:52:02 2021] GET /compute/v2.1/servers/d2c0f276-f763-4337-a5dd-0c328c8c2e73 => generated 1730 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 10:52:03.301684 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [req-62305351-bf60-45dd-ab53-9f8dff65201e req-fafde70e-be00-4a30-98b4-82ff1b1ea50c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8f5b5fe7-eb9b-4c53-a76a-ea25e7910dd0", "tag": "42a1a6bb-662d-484d-8547-95806531bcb0"}]} {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:52:03.307253 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 10:52:03.307253 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: warnings.warn(msg) Dec 24 10:52:03.311411 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [req-62305351-bf60-45dd-ab53-9f8dff65201e req-fafde70e-be00-4a30-98b4-82ff1b1ea50c service nova] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:52:03.311973 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [req-62305351-bf60-45dd-ab53-9f8dff65201e req-fafde70e-be00-4a30-98b4-82ff1b1ea50c service nova] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:52:03.323662 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.compute.server_external_events [req-62305351-bf60-45dd-ab53-9f8dff65201e req-fafde70e-be00-4a30-98b4-82ff1b1ea50c service nova] Creating event network-changed:42a1a6bb-662d-484d-8547-95806531bcb0 for instance 8f5b5fe7-eb9b-4c53-a76a-ea25e7910dd0 on hv-cinder-81644 Dec 24 10:52:03.329153 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [req-62305351-bf60-45dd-ab53-9f8dff65201e req-fafde70e-be00-4a30-98b4-82ff1b1ea50c service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031074 Dec 24 10:52:03.329880 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 558/1115] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Dec 24 10:52:03 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 10:52:03.339149 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-733124b3-c673-484c-b254-d8b7eb9b2bf8 tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:52:03.339761 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-733124b3-c673-484c-b254-d8b7eb9b2bf8 tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] [instance: 8f5b5fe7-eb9b-4c53-a76a-ea25e7910dd0] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:52:03.346606 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-733124b3-c673-484c-b254-d8b7eb9b2bf8 tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:52:03.347061 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-733124b3-c673-484c-b254-d8b7eb9b2bf8 tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:52:03.347863 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-733124b3-c673-484c-b254-d8b7eb9b2bf8 tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:52:03.348303 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-733124b3-c673-484c-b254-d8b7eb9b2bf8 tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:52:03.563662 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-733124b3-c673-484c-b254-d8b7eb9b2bf8 tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc441b6f06b44beb2a85f854cf92dd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696f3d18f3af4e0eb5760d829e0c3977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:52:03.572306 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-733124b3-c673-484c-b254-d8b7eb9b2bf8 tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] 10.222.0.30 "GET /compute/v2.1/servers/8f5b5fe7-eb9b-4c53-a76a-ea25e7910dd0" status: 200 len: 1318 microversion: 2.1 time: 0.237238 Dec 24 10:52:03.576368 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 558/1116] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:52:03 2021] GET /compute/v2.1/servers/8f5b5fe7-eb9b-4c53-a76a-ea25e7910dd0 => generated 1318 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 24 10:52:04.151996 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-4f59a7bd-7991-41d1-b614-1819c2e2d12b tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:52:04.152870 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-4f59a7bd-7991-41d1-b614-1819c2e2d12b tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] [instance: d2c0f276-f763-4337-a5dd-0c328c8c2e73] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:52:04.159064 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-4f59a7bd-7991-41d1-b614-1819c2e2d12b tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:52:04.159511 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-4f59a7bd-7991-41d1-b614-1819c2e2d12b tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:52:04.160416 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-4f59a7bd-7991-41d1-b614-1819c2e2d12b tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:52:04.160918 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-4f59a7bd-7991-41d1-b614-1819c2e2d12b tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:52:04.295980 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-4f59a7bd-7991-41d1-b614-1819c2e2d12b tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:52:04.303981 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-4f59a7bd-7991-41d1-b614-1819c2e2d12b tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:52:04.305531 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-4f59a7bd-7991-41d1-b614-1819c2e2d12b tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:52:04.306677 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-4f59a7bd-7991-41d1-b614-1819c2e2d12b tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] 10.222.0.30 "GET /compute/v2.1/servers/d2c0f276-f763-4337-a5dd-0c328c8c2e73" status: 200 len: 1717 microversion: 2.20 time: 0.158859 Dec 24 10:52:04.307237 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 559/1117] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Dec 24 10:52:04 2021] GET /compute/v2.1/servers/d2c0f276-f763-4337-a5dd-0c328c8c2e73 => generated 1717 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 24 10:52:04.591391 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-3e0d580c-da0a-4e68-998d-ab863bfb18f7 tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:52:04.592715 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-3e0d580c-da0a-4e68-998d-ab863bfb18f7 tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] [instance: 8f5b5fe7-eb9b-4c53-a76a-ea25e7910dd0] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:52:04.599678 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-3e0d580c-da0a-4e68-998d-ab863bfb18f7 tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:52:04.600050 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-3e0d580c-da0a-4e68-998d-ab863bfb18f7 tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:52:04.600859 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-3e0d580c-da0a-4e68-998d-ab863bfb18f7 tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:52:04.601294 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-3e0d580c-da0a-4e68-998d-ab863bfb18f7 tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:52:04.738530 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-3e0d580c-da0a-4e68-998d-ab863bfb18f7 tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc441b6f06b44beb2a85f854cf92dd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696f3d18f3af4e0eb5760d829e0c3977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:52:04.746178 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-3e0d580c-da0a-4e68-998d-ab863bfb18f7 tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] 10.222.0.30 "GET /compute/v2.1/servers/8f5b5fe7-eb9b-4c53-a76a-ea25e7910dd0" status: 200 len: 1318 microversion: 2.1 time: 0.160169 Dec 24 10:52:04.746756 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 559/1118] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:52:04 2021] GET /compute/v2.1/servers/8f5b5fe7-eb9b-4c53-a76a-ea25e7910dd0 => generated 1318 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:52:05.762249 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-ffb3b93d-2e1a-4254-9000-d3d63be816cd tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:52:05.762885 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-ffb3b93d-2e1a-4254-9000-d3d63be816cd tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] [instance: 8f5b5fe7-eb9b-4c53-a76a-ea25e7910dd0] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:52:05.769498 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-ffb3b93d-2e1a-4254-9000-d3d63be816cd tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:52:05.769945 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-ffb3b93d-2e1a-4254-9000-d3d63be816cd tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:52:05.770726 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-ffb3b93d-2e1a-4254-9000-d3d63be816cd tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:52:05.771158 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-ffb3b93d-2e1a-4254-9000-d3d63be816cd tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:52:05.918748 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-ffb3b93d-2e1a-4254-9000-d3d63be816cd tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc441b6f06b44beb2a85f854cf92dd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696f3d18f3af4e0eb5760d829e0c3977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:52:05.925951 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-ffb3b93d-2e1a-4254-9000-d3d63be816cd tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] 10.222.0.30 "GET /compute/v2.1/servers/8f5b5fe7-eb9b-4c53-a76a-ea25e7910dd0" status: 200 len: 1318 microversion: 2.1 time: 0.167272 Dec 24 10:52:05.926506 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 560/1119] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:52:05 2021] GET /compute/v2.1/servers/8f5b5fe7-eb9b-4c53-a76a-ea25e7910dd0 => generated 1318 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:52:06.423738 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-22703fb2-c78d-42d4-b9b4-eb41eec754c0 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:52:06.424645 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-22703fb2-c78d-42d4-b9b4-eb41eec754c0 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] [instance: 1e267da4-1e48-4136-babc-656ccd50aae2] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:52:06.431217 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-22703fb2-c78d-42d4-b9b4-eb41eec754c0 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:52:06.431664 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-22703fb2-c78d-42d4-b9b4-eb41eec754c0 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:52:06.432434 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-22703fb2-c78d-42d4-b9b4-eb41eec754c0 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:52:06.432888 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-22703fb2-c78d-42d4-b9b4-eb41eec754c0 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:52:06.462284 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-22703fb2-c78d-42d4-b9b4-eb41eec754c0 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] 10.222.0.30 "GET /compute/v2.1/servers/1e267da4-1e48-4136-babc-656ccd50aae2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042243 Dec 24 10:52:06.462830 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 560/1120] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Dec 24 10:52:06 2021] GET /compute/v2.1/servers/1e267da4-1e48-4136-babc-656ccd50aae2/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 10:52:06.472674 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-be3acc45-c7c8-4221-ab3f-3e9a0563f0d1 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:52:06.473184 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-be3acc45-c7c8-4221-ab3f-3e9a0563f0d1 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] [instance: 1e267da4-1e48-4136-babc-656ccd50aae2] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:52:06.480225 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-be3acc45-c7c8-4221-ab3f-3e9a0563f0d1 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:52:06.480669 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-be3acc45-c7c8-4221-ab3f-3e9a0563f0d1 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:52:06.481484 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-be3acc45-c7c8-4221-ab3f-3e9a0563f0d1 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:52:06.481902 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-be3acc45-c7c8-4221-ab3f-3e9a0563f0d1 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:52:06.675989 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-be3acc45-c7c8-4221-ab3f-3e9a0563f0d1 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] 10.222.0.30 "GET /compute/v2.1/servers/1e267da4-1e48-4136-babc-656ccd50aae2/os-volume_attachments/f560cf3a-ef73-4da8-9ff1-5ad327c84be2" status: 200 len: 194 microversion: 2.1 time: 0.207057 Dec 24 10:52:06.676565 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 561/1121] 10.222.0.30 () {58 vars in 1412 bytes} [Fri Dec 24 10:52:06 2021] GET /compute/v2.1/servers/1e267da4-1e48-4136-babc-656ccd50aae2/os-volume_attachments/f560cf3a-ef73-4da8-9ff1-5ad327c84be2 => generated 194 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 10:52:06.941726 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-3f27aca9-1f4f-4479-908e-7654bf8b5bf6 tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:52:06.942482 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-3f27aca9-1f4f-4479-908e-7654bf8b5bf6 tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] [instance: 8f5b5fe7-eb9b-4c53-a76a-ea25e7910dd0] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:52:06.948645 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-3f27aca9-1f4f-4479-908e-7654bf8b5bf6 tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:52:06.949122 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-3f27aca9-1f4f-4479-908e-7654bf8b5bf6 tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:52:06.949909 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-3f27aca9-1f4f-4479-908e-7654bf8b5bf6 tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:52:06.950490 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-3f27aca9-1f4f-4479-908e-7654bf8b5bf6 tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:52:07.084309 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-3f27aca9-1f4f-4479-908e-7654bf8b5bf6 tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc441b6f06b44beb2a85f854cf92dd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696f3d18f3af4e0eb5760d829e0c3977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:52:07.091622 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-3f27aca9-1f4f-4479-908e-7654bf8b5bf6 tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] 10.222.0.30 "GET /compute/v2.1/servers/8f5b5fe7-eb9b-4c53-a76a-ea25e7910dd0" status: 200 len: 1318 microversion: 2.1 time: 0.153783 Dec 24 10:52:07.092195 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 561/1122] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:52:06 2021] GET /compute/v2.1/servers/8f5b5fe7-eb9b-4c53-a76a-ea25e7910dd0 => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:52:08.107091 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-156584d6-1c92-4a36-a38a-8850251d8127 tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:52:08.107778 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-156584d6-1c92-4a36-a38a-8850251d8127 tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] [instance: 8f5b5fe7-eb9b-4c53-a76a-ea25e7910dd0] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:52:08.114057 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-156584d6-1c92-4a36-a38a-8850251d8127 tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:52:08.114501 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-156584d6-1c92-4a36-a38a-8850251d8127 tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:52:08.115277 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-156584d6-1c92-4a36-a38a-8850251d8127 tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:52:08.115711 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-156584d6-1c92-4a36-a38a-8850251d8127 tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:52:08.247718 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-25602955-bcf7-4d0b-b39c-2f2774119498 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "153554c0-fdbd-40ed-a606-a7daefb272d9"}} {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:52:08.248418 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-156584d6-1c92-4a36-a38a-8850251d8127 tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc441b6f06b44beb2a85f854cf92dd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696f3d18f3af4e0eb5760d829e0c3977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:52:08.248771 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-25602955-bcf7-4d0b-b39c-2f2774119498 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] [instance: 1e267da4-1e48-4136-babc-656ccd50aae2] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:52:08.254982 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-25602955-bcf7-4d0b-b39c-2f2774119498 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:52:08.255437 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-25602955-bcf7-4d0b-b39c-2f2774119498 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:52:08.255830 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-156584d6-1c92-4a36-a38a-8850251d8127 tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] 10.222.0.30 "GET /compute/v2.1/servers/8f5b5fe7-eb9b-4c53-a76a-ea25e7910dd0" status: 200 len: 1318 microversion: 2.1 time: 0.152430 Dec 24 10:52:08.256216 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-25602955-bcf7-4d0b-b39c-2f2774119498 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:52:08.256390 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 562/1123] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:52:08 2021] GET /compute/v2.1/servers/8f5b5fe7-eb9b-4c53-a76a-ea25e7910dd0 => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:52:08.256651 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-25602955-bcf7-4d0b-b39c-2f2774119498 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:52:09.108800 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-25602955-bcf7-4d0b-b39c-2f2774119498 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] 10.222.0.30 "POST /compute/v2.1/servers/1e267da4-1e48-4136-babc-656ccd50aae2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.864619 Dec 24 10:52:09.109397 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 562/1124] 10.222.0.30 () {60 vars in 1322 bytes} [Fri Dec 24 10:52:08 2021] POST /compute/v2.1/servers/1e267da4-1e48-4136-babc-656ccd50aae2/os-volume_attachments => generated 194 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 24 10:52:09.273420 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-31e44b20-53de-45f8-963d-f1724c9fe41b tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:52:09.274075 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-31e44b20-53de-45f8-963d-f1724c9fe41b tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] [instance: 8f5b5fe7-eb9b-4c53-a76a-ea25e7910dd0] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:52:09.281019 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-31e44b20-53de-45f8-963d-f1724c9fe41b tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:52:09.282146 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-31e44b20-53de-45f8-963d-f1724c9fe41b tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:52:09.282488 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-31e44b20-53de-45f8-963d-f1724c9fe41b tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:52:09.282915 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-31e44b20-53de-45f8-963d-f1724c9fe41b tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:52:09.431167 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-31e44b20-53de-45f8-963d-f1724c9fe41b tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc441b6f06b44beb2a85f854cf92dd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696f3d18f3af4e0eb5760d829e0c3977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:52:09.438374 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-31e44b20-53de-45f8-963d-f1724c9fe41b tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] 10.222.0.30 "GET /compute/v2.1/servers/8f5b5fe7-eb9b-4c53-a76a-ea25e7910dd0" status: 200 len: 1318 microversion: 2.1 time: 0.168527 Dec 24 10:52:09.439057 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 563/1125] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:52:09 2021] GET /compute/v2.1/servers/8f5b5fe7-eb9b-4c53-a76a-ea25e7910dd0 => generated 1318 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:52:09.568164 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [req-666b770a-3adf-43d6-9692-132e678144b9 req-986359ed-6c0b-43c8-85ba-14b258e1c6f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f5b5fe7-eb9b-4c53-a76a-ea25e7910dd0", "name": "network-vif-plugged", "status": "completed", "tag": "42a1a6bb-662d-484d-8547-95806531bcb0"}]} {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:52:09.569933 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 10:52:09.569933 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: warnings.warn(msg) Dec 24 10:52:09.577495 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [req-666b770a-3adf-43d6-9692-132e678144b9 req-986359ed-6c0b-43c8-85ba-14b258e1c6f7 service nova] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:52:09.577932 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [req-666b770a-3adf-43d6-9692-132e678144b9 req-986359ed-6c0b-43c8-85ba-14b258e1c6f7 service nova] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:52:09.589365 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.compute.server_external_events [req-666b770a-3adf-43d6-9692-132e678144b9 req-986359ed-6c0b-43c8-85ba-14b258e1c6f7 service nova] Creating event network-vif-plugged:42a1a6bb-662d-484d-8547-95806531bcb0 for instance 8f5b5fe7-eb9b-4c53-a76a-ea25e7910dd0 on hv-cinder-81644 Dec 24 10:52:09.594209 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [req-666b770a-3adf-43d6-9692-132e678144b9 req-986359ed-6c0b-43c8-85ba-14b258e1c6f7 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030057 Dec 24 10:52:09.594801 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 563/1126] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Dec 24 10:52:09 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 10:52:10.454676 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-d7a4f785-7ea7-47b7-aa03-7a44919e8cbc tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:52:10.455274 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-d7a4f785-7ea7-47b7-aa03-7a44919e8cbc tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] [instance: 8f5b5fe7-eb9b-4c53-a76a-ea25e7910dd0] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:52:10.461454 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-d7a4f785-7ea7-47b7-aa03-7a44919e8cbc tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:52:10.461894 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-d7a4f785-7ea7-47b7-aa03-7a44919e8cbc tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:52:10.462651 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-d7a4f785-7ea7-47b7-aa03-7a44919e8cbc tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:52:10.463075 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-d7a4f785-7ea7-47b7-aa03-7a44919e8cbc tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:52:10.588221 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-d7a4f785-7ea7-47b7-aa03-7a44919e8cbc tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc441b6f06b44beb2a85f854cf92dd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696f3d18f3af4e0eb5760d829e0c3977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:52:10.595437 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-d7a4f785-7ea7-47b7-aa03-7a44919e8cbc tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] 10.222.0.30 "GET /compute/v2.1/servers/8f5b5fe7-eb9b-4c53-a76a-ea25e7910dd0" status: 200 len: 1318 microversion: 2.1 time: 0.144325 Dec 24 10:52:10.595991 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 564/1127] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:52:10 2021] GET /compute/v2.1/servers/8f5b5fe7-eb9b-4c53-a76a-ea25e7910dd0 => generated 1318 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:52:11.612541 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-75b17b84-386d-4060-8495-ce4c2841396c tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:52:11.613193 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-75b17b84-386d-4060-8495-ce4c2841396c tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] [instance: 8f5b5fe7-eb9b-4c53-a76a-ea25e7910dd0] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:52:11.620350 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-75b17b84-386d-4060-8495-ce4c2841396c tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:52:11.620802 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-75b17b84-386d-4060-8495-ce4c2841396c tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:52:11.621656 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-75b17b84-386d-4060-8495-ce4c2841396c tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:52:11.622090 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-75b17b84-386d-4060-8495-ce4c2841396c tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:52:11.754678 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-75b17b84-386d-4060-8495-ce4c2841396c tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc441b6f06b44beb2a85f854cf92dd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696f3d18f3af4e0eb5760d829e0c3977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:52:11.761859 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-75b17b84-386d-4060-8495-ce4c2841396c tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] 10.222.0.30 "GET /compute/v2.1/servers/8f5b5fe7-eb9b-4c53-a76a-ea25e7910dd0" status: 200 len: 1507 microversion: 2.1 time: 0.153513 Dec 24 10:52:11.762418 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 564/1128] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:52:11 2021] GET /compute/v2.1/servers/8f5b5fe7-eb9b-4c53-a76a-ea25e7910dd0 => generated 1507 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:52:11.778527 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-7474cc1d-2f5c-4d08-ad7e-11500cc63d6f tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "86f2ea81-50aa-4971-b182-bed6a21e2eb1", "device": "/dev/sdb"}} {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:52:11.779680 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-7474cc1d-2f5c-4d08-ad7e-11500cc63d6f tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] [instance: 8f5b5fe7-eb9b-4c53-a76a-ea25e7910dd0] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:52:11.785875 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-7474cc1d-2f5c-4d08-ad7e-11500cc63d6f tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:52:11.786314 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-7474cc1d-2f5c-4d08-ad7e-11500cc63d6f tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:52:11.787146 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-7474cc1d-2f5c-4d08-ad7e-11500cc63d6f tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:52:11.787551 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-7474cc1d-2f5c-4d08-ad7e-11500cc63d6f tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:52:12.828878 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-7474cc1d-2f5c-4d08-ad7e-11500cc63d6f tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] 10.222.0.30 "POST /compute/v2.1/servers/8f5b5fe7-eb9b-4c53-a76a-ea25e7910dd0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.053759 Dec 24 10:52:12.829795 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 565/1129] 10.222.0.30 () {60 vars in 1322 bytes} [Fri Dec 24 10:52:11 2021] POST /compute/v2.1/servers/8f5b5fe7-eb9b-4c53-a76a-ea25e7910dd0/os-volume_attachments => generated 194 bytes in 1056 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 10:52:17.617951 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-6d00a4df-29be-4aca-b018-ffaf7823a398 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:52:17.618856 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-6d00a4df-29be-4aca-b018-ffaf7823a398 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] [instance: 1e267da4-1e48-4136-babc-656ccd50aae2] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:52:17.625088 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-6d00a4df-29be-4aca-b018-ffaf7823a398 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:52:17.625531 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-6d00a4df-29be-4aca-b018-ffaf7823a398 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:52:17.626297 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-6d00a4df-29be-4aca-b018-ffaf7823a398 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:52:17.626725 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-6d00a4df-29be-4aca-b018-ffaf7823a398 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:52:17.658399 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-6d00a4df-29be-4aca-b018-ffaf7823a398 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] 10.222.0.30 "GET /compute/v2.1/servers/1e267da4-1e48-4136-babc-656ccd50aae2/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044166 Dec 24 10:52:17.658946 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 565/1130] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Dec 24 10:52:17 2021] GET /compute/v2.1/servers/1e267da4-1e48-4136-babc-656ccd50aae2/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 10:52:17.943317 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-64d0bd2e-4a46-4682-bedb-b8b73f54aa70 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:52:17.943943 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-64d0bd2e-4a46-4682-bedb-b8b73f54aa70 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] [instance: 1e267da4-1e48-4136-babc-656ccd50aae2] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:52:17.950648 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-64d0bd2e-4a46-4682-bedb-b8b73f54aa70 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:52:17.951095 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-64d0bd2e-4a46-4682-bedb-b8b73f54aa70 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:52:17.951867 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-64d0bd2e-4a46-4682-bedb-b8b73f54aa70 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:52:17.952299 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-64d0bd2e-4a46-4682-bedb-b8b73f54aa70 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:52:17.982984 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-64d0bd2e-4a46-4682-bedb-b8b73f54aa70 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] 10.222.0.30 "GET /compute/v2.1/servers/1e267da4-1e48-4136-babc-656ccd50aae2/os-volume_attachments/f560cf3a-ef73-4da8-9ff1-5ad327c84be2" status: 200 len: 194 microversion: 2.1 time: 0.043860 Dec 24 10:52:17.983558 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 566/1131] 10.222.0.30 () {58 vars in 1412 bytes} [Fri Dec 24 10:52:17 2021] GET /compute/v2.1/servers/1e267da4-1e48-4136-babc-656ccd50aae2/os-volume_attachments/f560cf3a-ef73-4da8-9ff1-5ad327c84be2 => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 10:52:17.993599 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-3f667550-7972-41db-8679-800575a8c81e tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:52:17.994088 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-3f667550-7972-41db-8679-800575a8c81e tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] [instance: 1e267da4-1e48-4136-babc-656ccd50aae2] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:52:18.000500 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-3f667550-7972-41db-8679-800575a8c81e tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:52:18.000997 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-3f667550-7972-41db-8679-800575a8c81e tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:52:18.001778 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-3f667550-7972-41db-8679-800575a8c81e tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:52:18.002210 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-3f667550-7972-41db-8679-800575a8c81e tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:52:18.078628 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.objects.instance [None req-3f667550-7972-41db-8679-800575a8c81e tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lazy-loading 'services' on Instance uuid 1e267da4-1e48-4136-babc-656ccd50aae2 {{(pid=123431) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 24 10:52:18.389639 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-3f667550-7972-41db-8679-800575a8c81e tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] 10.222.0.30 "DELETE /compute/v2.1/servers/1e267da4-1e48-4136-babc-656ccd50aae2/os-volume_attachments/f560cf3a-ef73-4da8-9ff1-5ad327c84be2" status: 202 len: 0 microversion: 2.1 time: 0.399745 Dec 24 10:52:18.390688 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 566/1132] 10.222.0.30 () {58 vars in 1415 bytes} [Fri Dec 24 10:52:17 2021] DELETE /compute/v2.1/servers/1e267da4-1e48-4136-babc-656ccd50aae2/os-volume_attachments/f560cf3a-ef73-4da8-9ff1-5ad327c84be2 => generated 0 bytes in 402 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 24 10:52:25.096113 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-29c7a879-317b-43a0-be30-eb2eed25fdde tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-965106165", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-546307184", "security_groups": [{"name": "tempest-secgroup-smoke-1980485842"}], "networks": [{"uuid": "1dab6358-bb50-4a49-a0c2-25295aed92f4"}], "block_device_mapping_v2": [{"uuid": "d108ca4b-2af1-4c62-84cf-af0881fd59da", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:52:25.216725 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.network.neutron [None req-29c7a879-317b-43a0-be30-eb2eed25fdde tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] validate_networks() for [('1dab6358-bb50-4a49-a0c2-25295aed92f4', None, None, None, None, None)] {{(pid=123432) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 24 10:52:25.574708 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.virt.hardware [None req-29c7a879-317b-43a0-be30-eb2eed25fdde tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Flavor limits 0:0:0 {{(pid=123432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 24 10:52:25.574708 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.virt.hardware [None req-29c7a879-317b-43a0-be30-eb2eed25fdde tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Image limits 0:0:0 {{(pid=123432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 24 10:52:25.574708 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.virt.hardware [None req-29c7a879-317b-43a0-be30-eb2eed25fdde tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Flavor pref 0:0:0 {{(pid=123432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 24 10:52:25.574708 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.virt.hardware [None req-29c7a879-317b-43a0-be30-eb2eed25fdde tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Image pref 0:0:0 {{(pid=123432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 24 10:52:25.574708 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.virt.hardware [None req-29c7a879-317b-43a0-be30-eb2eed25fdde tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 24 10:52:25.582232 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-29c7a879-317b-43a0-be30-eb2eed25fdde tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:52:25.582676 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-29c7a879-317b-43a0-be30-eb2eed25fdde tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:52:25.583484 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-29c7a879-317b-43a0-be30-eb2eed25fdde tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:52:25.583925 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-29c7a879-317b-43a0-be30-eb2eed25fdde tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:52:25.599585 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.quota [None req-29c7a879-317b-43a0-be30-eb2eed25fdde tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Getting quotas for project 9abda8fd8574437e892913c775910de0. Resources: {'instances', 'cores', 'ram'} {{(pid=123432) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 24 10:52:25.604045 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.quota [None req-29c7a879-317b-43a0-be30-eb2eed25fdde tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Getting quotas for user f366d62f6b3f4a0487d37e765a3fad02 and project 9abda8fd8574437e892913c775910de0. Resources: {'instances', 'cores', 'ram'} {{(pid=123432) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 24 10:52:25.942208 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-29c7a879-317b-43a0-be30-eb2eed25fdde tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Going to run 1 instances... {{(pid=123432) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 24 10:52:25.942559 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-29c7a879-317b-43a0-be30-eb2eed25fdde tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] [instance: ffb09c23-c1d1-4e71-9510-70dd7a07cc40] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='d108ca4b-2af1-4c62-84cf-af0881fd59da',volume_size=None,volume_type=None)] {{(pid=123432) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 24 10:52:25.993454 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-4bd4c303-a13a-454d-a6ae-43b7965651b9 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:52:25.994032 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-4bd4c303-a13a-454d-a6ae-43b7965651b9 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] [instance: 1e267da4-1e48-4136-babc-656ccd50aae2] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:52:26.000708 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-4bd4c303-a13a-454d-a6ae-43b7965651b9 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:52:26.001187 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-4bd4c303-a13a-454d-a6ae-43b7965651b9 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:52:26.002019 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-4bd4c303-a13a-454d-a6ae-43b7965651b9 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:52:26.002448 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-4bd4c303-a13a-454d-a6ae-43b7965651b9 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:52:26.032002 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-4bd4c303-a13a-454d-a6ae-43b7965651b9 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] 10.222.0.30 "GET /compute/v2.1/servers/1e267da4-1e48-4136-babc-656ccd50aae2/os-volume_attachments/153554c0-fdbd-40ed-a606-a7daefb272d9" status: 200 len: 194 microversion: 2.1 time: 0.043025 Dec 24 10:52:26.032583 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 567/1133] 10.222.0.30 () {58 vars in 1412 bytes} [Fri Dec 24 10:52:25 2021] GET /compute/v2.1/servers/1e267da4-1e48-4136-babc-656ccd50aae2/os-volume_attachments/153554c0-fdbd-40ed-a606-a7daefb272d9 => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 10:52:26.042380 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-7432cdec-5199-4845-8593-46a0ed25b4fd tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:52:26.042869 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-7432cdec-5199-4845-8593-46a0ed25b4fd tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] [instance: 1e267da4-1e48-4136-babc-656ccd50aae2] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:52:26.048656 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-7432cdec-5199-4845-8593-46a0ed25b4fd tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:52:26.049150 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-7432cdec-5199-4845-8593-46a0ed25b4fd tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:52:26.050657 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-7432cdec-5199-4845-8593-46a0ed25b4fd tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:52:26.050657 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-7432cdec-5199-4845-8593-46a0ed25b4fd tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:52:26.314645 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.objects.instance [None req-7432cdec-5199-4845-8593-46a0ed25b4fd tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lazy-loading 'services' on Instance uuid 1e267da4-1e48-4136-babc-656ccd50aae2 {{(pid=123431) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 24 10:52:26.708082 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-7432cdec-5199-4845-8593-46a0ed25b4fd tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] 10.222.0.30 "DELETE /compute/v2.1/servers/1e267da4-1e48-4136-babc-656ccd50aae2/os-volume_attachments/153554c0-fdbd-40ed-a606-a7daefb272d9" status: 202 len: 0 microversion: 2.1 time: 0.669608 Dec 24 10:52:26.708676 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 568/1134] 10.222.0.30 () {58 vars in 1415 bytes} [Fri Dec 24 10:52:26 2021] DELETE /compute/v2.1/servers/1e267da4-1e48-4136-babc-656ccd50aae2/os-volume_attachments/153554c0-fdbd-40ed-a606-a7daefb272d9 => generated 0 bytes in 671 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Dec 24 10:52:26.911436 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-29c7a879-317b-43a0-be30-eb2eed25fdde tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.818950 Dec 24 10:52:26.912076 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 567/1135] 10.222.0.30 () {60 vars in 1146 bytes} [Fri Dec 24 10:52:25 2021] POST /compute/v2.1/servers => generated 406 bytes in 1820 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 24 10:52:26.922227 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-5b0b3436-2e21-4307-985d-3abc41c62687 tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:52:26.922916 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-5b0b3436-2e21-4307-985d-3abc41c62687 tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] [instance: ffb09c23-c1d1-4e71-9510-70dd7a07cc40] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:52:26.975052 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-5b0b3436-2e21-4307-985d-3abc41c62687 tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366d62f6b3f4a0487d37e765a3fad02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abda8fd8574437e892913c775910de0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:52:26.981730 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-5b0b3436-2e21-4307-985d-3abc41c62687 tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] 10.222.0.30 "GET /compute/v2.1/servers/ffb09c23-c1d1-4e71-9510-70dd7a07cc40" status: 200 len: 1087 microversion: 2.1 time: 0.063529 Dec 24 10:52:26.982302 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 569/1136] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:52:26 2021] GET /compute/v2.1/servers/ffb09c23-c1d1-4e71-9510-70dd7a07cc40 => generated 1087 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:52:27.998911 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-9bf45156-91d2-4011-b97d-bb1bea9070fa tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:52:27.999556 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-9bf45156-91d2-4011-b97d-bb1bea9070fa tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] [instance: ffb09c23-c1d1-4e71-9510-70dd7a07cc40] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:52:28.053462 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-9bf45156-91d2-4011-b97d-bb1bea9070fa tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366d62f6b3f4a0487d37e765a3fad02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abda8fd8574437e892913c775910de0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:52:28.059961 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-9bf45156-91d2-4011-b97d-bb1bea9070fa tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] 10.222.0.30 "GET /compute/v2.1/servers/ffb09c23-c1d1-4e71-9510-70dd7a07cc40" status: 200 len: 1087 microversion: 2.1 time: 0.065293 Dec 24 10:52:28.060515 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 568/1137] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:52:27 2021] GET /compute/v2.1/servers/ffb09c23-c1d1-4e71-9510-70dd7a07cc40 => generated 1087 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:52:29.076304 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-116d1b11-7449-4717-969d-9bfac2529e18 tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:52:29.076951 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-116d1b11-7449-4717-969d-9bfac2529e18 tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] [instance: ffb09c23-c1d1-4e71-9510-70dd7a07cc40] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:52:29.083959 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-116d1b11-7449-4717-969d-9bfac2529e18 tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:52:29.084407 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-116d1b11-7449-4717-969d-9bfac2529e18 tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:52:29.085233 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-116d1b11-7449-4717-969d-9bfac2529e18 tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:52:29.086217 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-116d1b11-7449-4717-969d-9bfac2529e18 tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:52:29.146373 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-116d1b11-7449-4717-969d-9bfac2529e18 tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366d62f6b3f4a0487d37e765a3fad02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abda8fd8574437e892913c775910de0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:52:29.151326 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-116d1b11-7449-4717-969d-9bfac2529e18 tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] 10.222.0.30 "GET /compute/v2.1/servers/ffb09c23-c1d1-4e71-9510-70dd7a07cc40" status: 200 len: 1137 microversion: 2.1 time: 0.078734 Dec 24 10:52:29.152901 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 570/1138] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:52:29 2021] GET /compute/v2.1/servers/ffb09c23-c1d1-4e71-9510-70dd7a07cc40 => generated 1137 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:52:30.167596 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-6a96c4b7-b1aa-43b3-960b-e9cc08945246 tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:52:30.168230 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-6a96c4b7-b1aa-43b3-960b-e9cc08945246 tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] [instance: ffb09c23-c1d1-4e71-9510-70dd7a07cc40] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:52:30.174435 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-6a96c4b7-b1aa-43b3-960b-e9cc08945246 tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:52:30.174921 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-6a96c4b7-b1aa-43b3-960b-e9cc08945246 tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:52:30.175649 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-6a96c4b7-b1aa-43b3-960b-e9cc08945246 tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:52:30.176080 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-6a96c4b7-b1aa-43b3-960b-e9cc08945246 tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:52:30.233356 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-6a96c4b7-b1aa-43b3-960b-e9cc08945246 tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366d62f6b3f4a0487d37e765a3fad02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abda8fd8574437e892913c775910de0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:52:30.241109 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-6a96c4b7-b1aa-43b3-960b-e9cc08945246 tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] 10.222.0.30 "GET /compute/v2.1/servers/ffb09c23-c1d1-4e71-9510-70dd7a07cc40" status: 200 len: 1137 microversion: 2.1 time: 0.077192 Dec 24 10:52:30.241805 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 569/1139] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:52:30 2021] GET /compute/v2.1/servers/ffb09c23-c1d1-4e71-9510-70dd7a07cc40 => generated 1137 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:52:31.026723 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-e54eb510-61ee-4342-b0fb-05b0ea37ebc9 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:52:31.027729 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-e54eb510-61ee-4342-b0fb-05b0ea37ebc9 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] [instance: 1e267da4-1e48-4136-babc-656ccd50aae2] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:52:31.034183 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-e54eb510-61ee-4342-b0fb-05b0ea37ebc9 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:52:31.034616 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-e54eb510-61ee-4342-b0fb-05b0ea37ebc9 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:52:31.035398 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-e54eb510-61ee-4342-b0fb-05b0ea37ebc9 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:52:31.035841 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-e54eb510-61ee-4342-b0fb-05b0ea37ebc9 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:52:31.064922 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-e54eb510-61ee-4342-b0fb-05b0ea37ebc9 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] 10.222.0.30 "GET /compute/v2.1/servers/1e267da4-1e48-4136-babc-656ccd50aae2/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041937 Dec 24 10:52:31.065486 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 571/1140] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Dec 24 10:52:31 2021] GET /compute/v2.1/servers/1e267da4-1e48-4136-babc-656ccd50aae2/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 24 10:52:31.166251 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-9a6e620a-d2e1-484c-85fe-2debfbb7ce6a tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:52:31.167240 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-9a6e620a-d2e1-484c-85fe-2debfbb7ce6a tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] [instance: 1e267da4-1e48-4136-babc-656ccd50aae2] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:52:31.173555 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-9a6e620a-d2e1-484c-85fe-2debfbb7ce6a tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:52:31.174132 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-9a6e620a-d2e1-484c-85fe-2debfbb7ce6a tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:52:31.174762 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-9a6e620a-d2e1-484c-85fe-2debfbb7ce6a tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:52:31.175193 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-9a6e620a-d2e1-484c-85fe-2debfbb7ce6a tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:52:31.203850 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-9a6e620a-d2e1-484c-85fe-2debfbb7ce6a tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] 10.222.0.30 "GET /compute/v2.1/servers/1e267da4-1e48-4136-babc-656ccd50aae2/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041807 Dec 24 10:52:31.204400 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 570/1141] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Dec 24 10:52:31 2021] GET /compute/v2.1/servers/1e267da4-1e48-4136-babc-656ccd50aae2/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 24 10:52:31.257562 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-2e1d150c-1871-4b04-b19f-018e3f2ed888 tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:52:31.258180 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-2e1d150c-1871-4b04-b19f-018e3f2ed888 tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] [instance: ffb09c23-c1d1-4e71-9510-70dd7a07cc40] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:52:31.258456 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-4818fb27-875c-4e1a-b929-3e4373d0d294 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:52:31.258959 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-4818fb27-875c-4e1a-b929-3e4373d0d294 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] [instance: 1e267da4-1e48-4136-babc-656ccd50aae2] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:52:31.264071 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-2e1d150c-1871-4b04-b19f-018e3f2ed888 tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:52:31.264770 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-2e1d150c-1871-4b04-b19f-018e3f2ed888 tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:52:31.265155 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-4818fb27-875c-4e1a-b929-3e4373d0d294 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:52:31.265587 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-2e1d150c-1871-4b04-b19f-018e3f2ed888 tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:52:31.265714 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-4818fb27-875c-4e1a-b929-3e4373d0d294 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:52:31.266052 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-2e1d150c-1871-4b04-b19f-018e3f2ed888 tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:52:31.266487 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-4818fb27-875c-4e1a-b929-3e4373d0d294 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:52:31.266923 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-4818fb27-875c-4e1a-b929-3e4373d0d294 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:52:31.292043 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-4818fb27-875c-4e1a-b929-3e4373d0d294 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] [instance: 1e267da4-1e48-4136-babc-656ccd50aae2] Going to try to terminate instance {{(pid=123432) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 24 10:52:31.324951 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-2e1d150c-1871-4b04-b19f-018e3f2ed888 tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366d62f6b3f4a0487d37e765a3fad02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abda8fd8574437e892913c775910de0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:52:31.332507 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-2e1d150c-1871-4b04-b19f-018e3f2ed888 tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] 10.222.0.30 "GET /compute/v2.1/servers/ffb09c23-c1d1-4e71-9510-70dd7a07cc40" status: 200 len: 1185 microversion: 2.1 time: 0.078540 Dec 24 10:52:31.333092 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 572/1142] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:52:31 2021] GET /compute/v2.1/servers/ffb09c23-c1d1-4e71-9510-70dd7a07cc40 => generated 1185 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:52:31.611903 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-4818fb27-875c-4e1a-b929-3e4373d0d294 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] 10.222.0.30 "DELETE /compute/v2.1/servers/1e267da4-1e48-4136-babc-656ccd50aae2" status: 204 len: 0 microversion: 2.1 time: 0.356842 Dec 24 10:52:31.612713 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 571/1143] 10.222.0.30 () {58 vars in 1238 bytes} [Fri Dec 24 10:52:31 2021] DELETE /compute/v2.1/servers/1e267da4-1e48-4136-babc-656ccd50aae2 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Dec 24 10:52:31.624578 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-be5d79d8-ac23-40f5-8c70-5e63e85f4bbf tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:52:31.625599 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-be5d79d8-ac23-40f5-8c70-5e63e85f4bbf tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] [instance: 1e267da4-1e48-4136-babc-656ccd50aae2] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:52:31.633334 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-be5d79d8-ac23-40f5-8c70-5e63e85f4bbf tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:52:31.634108 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-be5d79d8-ac23-40f5-8c70-5e63e85f4bbf tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:52:31.635258 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-be5d79d8-ac23-40f5-8c70-5e63e85f4bbf tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:52:31.635914 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-be5d79d8-ac23-40f5-8c70-5e63e85f4bbf tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:52:31.770187 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-be5d79d8-ac23-40f5-8c70-5e63e85f4bbf tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37516225f9244c969ed168f6a024482a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0115a5cc8b4b1e8bffb84e0f3e0b08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:52:31.777984 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-be5d79d8-ac23-40f5-8c70-5e63e85f4bbf tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] 10.222.0.30 "GET /compute/v2.1/servers/1e267da4-1e48-4136-babc-656ccd50aae2" status: 200 len: 1673 microversion: 2.1 time: 0.157644 Dec 24 10:52:31.778557 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 573/1144] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:52:31 2021] GET /compute/v2.1/servers/1e267da4-1e48-4136-babc-656ccd50aae2 => generated 1673 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:52:32.350741 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-6b829d26-62c3-44c0-bcd2-0f692fe1b268 tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:52:32.351990 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-6b829d26-62c3-44c0-bcd2-0f692fe1b268 tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] [instance: ffb09c23-c1d1-4e71-9510-70dd7a07cc40] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:52:32.358588 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-6b829d26-62c3-44c0-bcd2-0f692fe1b268 tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:52:32.359028 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-6b829d26-62c3-44c0-bcd2-0f692fe1b268 tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:52:32.359901 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-6b829d26-62c3-44c0-bcd2-0f692fe1b268 tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:52:32.360333 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-6b829d26-62c3-44c0-bcd2-0f692fe1b268 tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:52:32.499414 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-6b829d26-62c3-44c0-bcd2-0f692fe1b268 tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366d62f6b3f4a0487d37e765a3fad02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abda8fd8574437e892913c775910de0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:52:32.546375 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-6b829d26-62c3-44c0-bcd2-0f692fe1b268 tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] 10.222.0.30 "GET /compute/v2.1/servers/ffb09c23-c1d1-4e71-9510-70dd7a07cc40" status: 200 len: 1271 microversion: 2.1 time: 0.199687 Dec 24 10:52:32.546992 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 572/1145] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:52:32 2021] GET /compute/v2.1/servers/ffb09c23-c1d1-4e71-9510-70dd7a07cc40 => generated 1271 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:52:32.795742 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-c75221a8-bcc0-4886-ac18-7df3be6ed134 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:52:32.799959 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-c75221a8-bcc0-4886-ac18-7df3be6ed134 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] [instance: 1e267da4-1e48-4136-babc-656ccd50aae2] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:52:32.806461 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-c75221a8-bcc0-4886-ac18-7df3be6ed134 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:52:32.806903 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-c75221a8-bcc0-4886-ac18-7df3be6ed134 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:52:32.807670 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-c75221a8-bcc0-4886-ac18-7df3be6ed134 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:52:32.808097 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-c75221a8-bcc0-4886-ac18-7df3be6ed134 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:52:33.032406 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-c75221a8-bcc0-4886-ac18-7df3be6ed134 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37516225f9244c969ed168f6a024482a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0115a5cc8b4b1e8bffb84e0f3e0b08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:52:33.041151 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-c75221a8-bcc0-4886-ac18-7df3be6ed134 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] 10.222.0.30 "GET /compute/v2.1/servers/1e267da4-1e48-4136-babc-656ccd50aae2" status: 200 len: 1673 microversion: 2.1 time: 0.249166 Dec 24 10:52:33.041920 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 574/1146] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:52:32 2021] GET /compute/v2.1/servers/1e267da4-1e48-4136-babc-656ccd50aae2 => generated 1673 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:52:33.233382 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [req-7cca4aa1-83a6-4335-91f5-d68c5da562e2 req-139ab025-109b-4ff1-85a7-6fa9026a7a0c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ffb09c23-c1d1-4e71-9510-70dd7a07cc40", "tag": "d66f0143-a5b5-43e9-9377-65eedc43836e"}]} {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:52:33.234860 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 10:52:33.234860 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: warnings.warn(msg) Dec 24 10:52:33.243067 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [req-7cca4aa1-83a6-4335-91f5-d68c5da562e2 req-139ab025-109b-4ff1-85a7-6fa9026a7a0c service nova] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:52:33.243428 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [req-7cca4aa1-83a6-4335-91f5-d68c5da562e2 req-139ab025-109b-4ff1-85a7-6fa9026a7a0c service nova] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:52:33.256097 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.compute.server_external_events [req-7cca4aa1-83a6-4335-91f5-d68c5da562e2 req-139ab025-109b-4ff1-85a7-6fa9026a7a0c service nova] Creating event network-changed:d66f0143-a5b5-43e9-9377-65eedc43836e for instance ffb09c23-c1d1-4e71-9510-70dd7a07cc40 on hv-cinder-81644 Dec 24 10:52:33.261115 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [req-7cca4aa1-83a6-4335-91f5-d68c5da562e2 req-139ab025-109b-4ff1-85a7-6fa9026a7a0c service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031349 Dec 24 10:52:33.261725 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 573/1147] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Dec 24 10:52:33 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 10:52:33.563329 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-9f613bda-e555-49a4-bce0-7ed6fdaa1738 tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:52:33.563838 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-9f613bda-e555-49a4-bce0-7ed6fdaa1738 tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] [instance: ffb09c23-c1d1-4e71-9510-70dd7a07cc40] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:52:33.569767 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-9f613bda-e555-49a4-bce0-7ed6fdaa1738 tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:52:33.570209 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-9f613bda-e555-49a4-bce0-7ed6fdaa1738 tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:52:33.570974 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-9f613bda-e555-49a4-bce0-7ed6fdaa1738 tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:52:33.571402 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-9f613bda-e555-49a4-bce0-7ed6fdaa1738 tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:52:33.699800 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-9f613bda-e555-49a4-bce0-7ed6fdaa1738 tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366d62f6b3f4a0487d37e765a3fad02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abda8fd8574437e892913c775910de0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:52:33.707003 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-9f613bda-e555-49a4-bce0-7ed6fdaa1738 tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] 10.222.0.30 "GET /compute/v2.1/servers/ffb09c23-c1d1-4e71-9510-70dd7a07cc40" status: 200 len: 1271 microversion: 2.1 time: 0.147427 Dec 24 10:52:33.707568 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 575/1148] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:52:33 2021] GET /compute/v2.1/servers/ffb09c23-c1d1-4e71-9510-70dd7a07cc40 => generated 1271 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:52:34.058611 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-ea446d72-0fd1-4fe2-80c4-042e627d31b6 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:52:34.059304 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-ea446d72-0fd1-4fe2-80c4-042e627d31b6 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] [instance: 1e267da4-1e48-4136-babc-656ccd50aae2] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:52:34.065829 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-ea446d72-0fd1-4fe2-80c4-042e627d31b6 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:52:34.066275 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-ea446d72-0fd1-4fe2-80c4-042e627d31b6 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:52:34.067043 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-ea446d72-0fd1-4fe2-80c4-042e627d31b6 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:52:34.067472 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-ea446d72-0fd1-4fe2-80c4-042e627d31b6 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:52:34.199671 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-ea446d72-0fd1-4fe2-80c4-042e627d31b6 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37516225f9244c969ed168f6a024482a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0115a5cc8b4b1e8bffb84e0f3e0b08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:52:34.206906 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-ea446d72-0fd1-4fe2-80c4-042e627d31b6 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] 10.222.0.30 "GET /compute/v2.1/servers/1e267da4-1e48-4136-babc-656ccd50aae2" status: 200 len: 1673 microversion: 2.1 time: 0.152340 Dec 24 10:52:34.207461 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 574/1149] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:52:34 2021] GET /compute/v2.1/servers/1e267da4-1e48-4136-babc-656ccd50aae2 => generated 1673 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:52:34.723843 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-ac87b95e-ce0b-41bd-8b93-680008728a49 tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:52:34.724442 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-ac87b95e-ce0b-41bd-8b93-680008728a49 tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] [instance: ffb09c23-c1d1-4e71-9510-70dd7a07cc40] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:52:34.731225 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-ac87b95e-ce0b-41bd-8b93-680008728a49 tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:52:34.731665 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-ac87b95e-ce0b-41bd-8b93-680008728a49 tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:52:34.732428 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-ac87b95e-ce0b-41bd-8b93-680008728a49 tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:52:34.732874 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-ac87b95e-ce0b-41bd-8b93-680008728a49 tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:52:34.875740 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-ac87b95e-ce0b-41bd-8b93-680008728a49 tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366d62f6b3f4a0487d37e765a3fad02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abda8fd8574437e892913c775910de0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:52:34.882932 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-ac87b95e-ce0b-41bd-8b93-680008728a49 tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] 10.222.0.30 "GET /compute/v2.1/servers/ffb09c23-c1d1-4e71-9510-70dd7a07cc40" status: 200 len: 1271 microversion: 2.1 time: 0.162777 Dec 24 10:52:34.883504 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 576/1150] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:52:34 2021] GET /compute/v2.1/servers/ffb09c23-c1d1-4e71-9510-70dd7a07cc40 => generated 1271 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:52:35.224374 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-5a4681c6-be7d-450b-a9fa-3a1a0a9dd6b5 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:52:35.225186 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-5a4681c6-be7d-450b-a9fa-3a1a0a9dd6b5 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] [instance: 1e267da4-1e48-4136-babc-656ccd50aae2] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:52:35.232257 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-5a4681c6-be7d-450b-a9fa-3a1a0a9dd6b5 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:52:35.232694 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-5a4681c6-be7d-450b-a9fa-3a1a0a9dd6b5 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:52:35.233511 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-5a4681c6-be7d-450b-a9fa-3a1a0a9dd6b5 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:52:35.233942 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-5a4681c6-be7d-450b-a9fa-3a1a0a9dd6b5 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:52:35.366583 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-5a4681c6-be7d-450b-a9fa-3a1a0a9dd6b5 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37516225f9244c969ed168f6a024482a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0115a5cc8b4b1e8bffb84e0f3e0b08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:52:35.375569 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-5a4681c6-be7d-450b-a9fa-3a1a0a9dd6b5 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] 10.222.0.30 "GET /compute/v2.1/servers/1e267da4-1e48-4136-babc-656ccd50aae2" status: 200 len: 1673 microversion: 2.1 time: 0.154815 Dec 24 10:52:35.376145 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 575/1151] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:52:35 2021] GET /compute/v2.1/servers/1e267da4-1e48-4136-babc-656ccd50aae2 => generated 1673 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:52:35.900051 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-fe41a233-8aa5-472b-b4bf-da9371116547 tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:52:35.900660 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-fe41a233-8aa5-472b-b4bf-da9371116547 tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] [instance: ffb09c23-c1d1-4e71-9510-70dd7a07cc40] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:52:35.906768 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-fe41a233-8aa5-472b-b4bf-da9371116547 tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:52:35.907210 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-fe41a233-8aa5-472b-b4bf-da9371116547 tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:52:35.908044 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-fe41a233-8aa5-472b-b4bf-da9371116547 tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:52:35.908475 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-fe41a233-8aa5-472b-b4bf-da9371116547 tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:52:36.050500 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-fe41a233-8aa5-472b-b4bf-da9371116547 tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366d62f6b3f4a0487d37e765a3fad02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abda8fd8574437e892913c775910de0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:52:36.057742 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-fe41a233-8aa5-472b-b4bf-da9371116547 tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] 10.222.0.30 "GET /compute/v2.1/servers/ffb09c23-c1d1-4e71-9510-70dd7a07cc40" status: 200 len: 1259 microversion: 2.1 time: 0.162050 Dec 24 10:52:36.058303 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 577/1152] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:52:35 2021] GET /compute/v2.1/servers/ffb09c23-c1d1-4e71-9510-70dd7a07cc40 => generated 1259 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:52:36.392969 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-8b82a0ca-c65d-4e52-afb7-70ae02fb50ae tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:52:36.393606 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-8b82a0ca-c65d-4e52-afb7-70ae02fb50ae tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] [instance: 1e267da4-1e48-4136-babc-656ccd50aae2] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:52:36.400857 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-8b82a0ca-c65d-4e52-afb7-70ae02fb50ae tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:52:36.401314 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-8b82a0ca-c65d-4e52-afb7-70ae02fb50ae tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:52:36.402119 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-8b82a0ca-c65d-4e52-afb7-70ae02fb50ae tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:52:36.402554 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-8b82a0ca-c65d-4e52-afb7-70ae02fb50ae tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:52:36.536989 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-8b82a0ca-c65d-4e52-afb7-70ae02fb50ae tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37516225f9244c969ed168f6a024482a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0115a5cc8b4b1e8bffb84e0f3e0b08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:52:36.544182 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-8b82a0ca-c65d-4e52-afb7-70ae02fb50ae tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] 10.222.0.30 "GET /compute/v2.1/servers/1e267da4-1e48-4136-babc-656ccd50aae2" status: 200 len: 1673 microversion: 2.1 time: 0.155163 Dec 24 10:52:36.544753 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 576/1153] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:52:36 2021] GET /compute/v2.1/servers/1e267da4-1e48-4136-babc-656ccd50aae2 => generated 1673 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:52:37.079289 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-09e19139-ceb9-4a02-929b-881d1845f679 tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:52:37.079905 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-09e19139-ceb9-4a02-929b-881d1845f679 tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] [instance: ffb09c23-c1d1-4e71-9510-70dd7a07cc40] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:52:37.086648 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-09e19139-ceb9-4a02-929b-881d1845f679 tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:52:37.087100 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-09e19139-ceb9-4a02-929b-881d1845f679 tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:52:37.087885 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-09e19139-ceb9-4a02-929b-881d1845f679 tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:52:37.088321 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-09e19139-ceb9-4a02-929b-881d1845f679 tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:52:37.314873 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-09e19139-ceb9-4a02-929b-881d1845f679 tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366d62f6b3f4a0487d37e765a3fad02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abda8fd8574437e892913c775910de0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:52:37.322682 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-09e19139-ceb9-4a02-929b-881d1845f679 tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] 10.222.0.30 "GET /compute/v2.1/servers/ffb09c23-c1d1-4e71-9510-70dd7a07cc40" status: 200 len: 1259 microversion: 2.1 time: 0.247102 Dec 24 10:52:37.323252 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 578/1154] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:52:37 2021] GET /compute/v2.1/servers/ffb09c23-c1d1-4e71-9510-70dd7a07cc40 => generated 1259 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:52:37.427464 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [req-a1f60594-9d55-4840-af2c-95b6b3749d22 req-fdbf9e8d-bc52-481b-a4ab-876f7bcb0e65 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e267da4-1e48-4136-babc-656ccd50aae2", "name": "network-vif-deleted", "tag": "77f6b8b9-344d-496a-a27c-ff476412f5e6"}]} {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:52:37.432391 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 10:52:37.432391 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: warnings.warn(msg) Dec 24 10:52:37.437920 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [req-a1f60594-9d55-4840-af2c-95b6b3749d22 req-fdbf9e8d-bc52-481b-a4ab-876f7bcb0e65 service nova] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:52:37.438520 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [req-a1f60594-9d55-4840-af2c-95b6b3749d22 req-fdbf9e8d-bc52-481b-a4ab-876f7bcb0e65 service nova] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:52:37.451656 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.compute.server_external_events [req-a1f60594-9d55-4840-af2c-95b6b3749d22 req-fdbf9e8d-bc52-481b-a4ab-876f7bcb0e65 service nova] Creating event network-vif-deleted:77f6b8b9-344d-496a-a27c-ff476412f5e6 for instance 1e267da4-1e48-4136-babc-656ccd50aae2 on hv-cinder-81644 Dec 24 10:52:37.457835 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [req-a1f60594-9d55-4840-af2c-95b6b3749d22 req-fdbf9e8d-bc52-481b-a4ab-876f7bcb0e65 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034189 Dec 24 10:52:37.458777 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 577/1155] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Dec 24 10:52:37 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 10:52:37.561658 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-86c3d910-4c40-4c30-8e0e-3c526189f775 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:52:37.562264 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-86c3d910-4c40-4c30-8e0e-3c526189f775 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] [instance: 1e267da4-1e48-4136-babc-656ccd50aae2] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:52:37.573082 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-86c3d910-4c40-4c30-8e0e-3c526189f775 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:52:37.573536 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-86c3d910-4c40-4c30-8e0e-3c526189f775 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:52:37.576492 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-86c3d910-4c40-4c30-8e0e-3c526189f775 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:52:37.578660 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-86c3d910-4c40-4c30-8e0e-3c526189f775 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:52:37.639856 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-86c3d910-4c40-4c30-8e0e-3c526189f775 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37516225f9244c969ed168f6a024482a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0115a5cc8b4b1e8bffb84e0f3e0b08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:52:37.647306 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-86c3d910-4c40-4c30-8e0e-3c526189f775 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] 10.222.0.30 "GET /compute/v2.1/servers/1e267da4-1e48-4136-babc-656ccd50aae2" status: 200 len: 1322 microversion: 2.1 time: 0.089442 Dec 24 10:52:37.648693 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 579/1156] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:52:37 2021] GET /compute/v2.1/servers/1e267da4-1e48-4136-babc-656ccd50aae2 => generated 1322 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:52:38.341551 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-ad1b2bfe-4795-4422-94ad-cc5d871a6ad5 tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:52:38.342471 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-ad1b2bfe-4795-4422-94ad-cc5d871a6ad5 tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] [instance: ffb09c23-c1d1-4e71-9510-70dd7a07cc40] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:52:38.348774 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-ad1b2bfe-4795-4422-94ad-cc5d871a6ad5 tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:52:38.349249 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-ad1b2bfe-4795-4422-94ad-cc5d871a6ad5 tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:52:38.350028 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-ad1b2bfe-4795-4422-94ad-cc5d871a6ad5 tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:52:38.350504 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-ad1b2bfe-4795-4422-94ad-cc5d871a6ad5 tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:52:38.506177 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-ad1b2bfe-4795-4422-94ad-cc5d871a6ad5 tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366d62f6b3f4a0487d37e765a3fad02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abda8fd8574437e892913c775910de0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:52:38.514629 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-ad1b2bfe-4795-4422-94ad-cc5d871a6ad5 tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] 10.222.0.30 "GET /compute/v2.1/servers/ffb09c23-c1d1-4e71-9510-70dd7a07cc40" status: 200 len: 1259 microversion: 2.1 time: 0.177195 Dec 24 10:52:38.515178 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 578/1157] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:52:38 2021] GET /compute/v2.1/servers/ffb09c23-c1d1-4e71-9510-70dd7a07cc40 => generated 1259 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:52:38.664610 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-a2699940-3a06-48e8-8df1-ab62bd60b4d3 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:52:38.665392 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-a2699940-3a06-48e8-8df1-ab62bd60b4d3 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] [instance: 1e267da4-1e48-4136-babc-656ccd50aae2] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:52:38.671648 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-a2699940-3a06-48e8-8df1-ab62bd60b4d3 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:52:38.672099 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-a2699940-3a06-48e8-8df1-ab62bd60b4d3 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:52:38.672899 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-a2699940-3a06-48e8-8df1-ab62bd60b4d3 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:52:38.673333 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-a2699940-3a06-48e8-8df1-ab62bd60b4d3 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:52:38.686561 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.wsgi [None req-a2699940-3a06-48e8-8df1-ab62bd60b4d3 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] HTTP exception thrown: Instance 1e267da4-1e48-4136-babc-656ccd50aae2 could not be found. Dec 24 10:52:38.687161 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-a2699940-3a06-48e8-8df1-ab62bd60b4d3 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Returning 404 to user: Instance 1e267da4-1e48-4136-babc-656ccd50aae2 could not be found. {{(pid=123431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 24 10:52:38.687988 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-a2699940-3a06-48e8-8df1-ab62bd60b4d3 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] 10.222.0.30 "GET /compute/v2.1/servers/1e267da4-1e48-4136-babc-656ccd50aae2" status: 404 len: 111 microversion: 2.1 time: 0.027081 Dec 24 10:52:38.688527 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 580/1158] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:52:38 2021] GET /compute/v2.1/servers/1e267da4-1e48-4136-babc-656ccd50aae2 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 24 10:52:38.697180 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-ee5ae30c-3414-4114-984a-ab5f2e701f69 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Calling method '.version_select at 0x7f1899a65c10>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:52:38.801653 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-ee5ae30c-3414-4114-984a-ab5f2e701f69 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1139497446" status: 202 len: 0 microversion: 2.1 time: 0.108587 Dec 24 10:52:38.802278 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 579/1159] 10.222.0.30 () {58 vars in 1220 bytes} [Fri Dec 24 10:52:38 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1139497446 => generated 0 bytes in 110 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 24 10:52:39.531781 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-b37a2736-1ac4-4808-8e8b-dc16ca278bab tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:52:39.532395 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-b37a2736-1ac4-4808-8e8b-dc16ca278bab tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] [instance: ffb09c23-c1d1-4e71-9510-70dd7a07cc40] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:52:39.538455 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-b37a2736-1ac4-4808-8e8b-dc16ca278bab tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:52:39.552727 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-b37a2736-1ac4-4808-8e8b-dc16ca278bab tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:52:39.552727 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-b37a2736-1ac4-4808-8e8b-dc16ca278bab tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:52:39.552727 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-b37a2736-1ac4-4808-8e8b-dc16ca278bab tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:52:39.604884 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-4f34d03b-dd50-4980-bd86-bfc29f7b690f tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:52:39.605411 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-4f34d03b-dd50-4980-bd86-bfc29f7b690f tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] [instance: 8f5b5fe7-eb9b-4c53-a76a-ea25e7910dd0] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:52:39.613107 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-4f34d03b-dd50-4980-bd86-bfc29f7b690f tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:52:39.614122 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-4f34d03b-dd50-4980-bd86-bfc29f7b690f tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:52:39.615107 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-4f34d03b-dd50-4980-bd86-bfc29f7b690f tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:52:39.615925 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-4f34d03b-dd50-4980-bd86-bfc29f7b690f tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:52:39.693134 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-b37a2736-1ac4-4808-8e8b-dc16ca278bab tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366d62f6b3f4a0487d37e765a3fad02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abda8fd8574437e892913c775910de0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:52:39.703863 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-b37a2736-1ac4-4808-8e8b-dc16ca278bab tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] 10.222.0.30 "GET /compute/v2.1/servers/ffb09c23-c1d1-4e71-9510-70dd7a07cc40" status: 200 len: 1259 microversion: 2.1 time: 0.175767 Dec 24 10:52:39.704429 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 581/1160] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:52:39 2021] GET /compute/v2.1/servers/ffb09c23-c1d1-4e71-9510-70dd7a07cc40 => generated 1259 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:52:39.708339 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.objects.instance [None req-4f34d03b-dd50-4980-bd86-bfc29f7b690f tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] Lazy-loading 'services' on Instance uuid 8f5b5fe7-eb9b-4c53-a76a-ea25e7910dd0 {{(pid=123432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 24 10:52:39.932095 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-4f34d03b-dd50-4980-bd86-bfc29f7b690f tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] 10.222.0.30 "DELETE /compute/v2.1/servers/8f5b5fe7-eb9b-4c53-a76a-ea25e7910dd0/os-volume_attachments/86f2ea81-50aa-4971-b182-bed6a21e2eb1" status: 202 len: 0 microversion: 2.1 time: 0.330767 Dec 24 10:52:39.932692 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 580/1161] 10.222.0.30 () {58 vars in 1415 bytes} [Fri Dec 24 10:52:39 2021] DELETE /compute/v2.1/servers/8f5b5fe7-eb9b-4c53-a76a-ea25e7910dd0/os-volume_attachments/86f2ea81-50aa-4971-b182-bed6a21e2eb1 => generated 0 bytes in 332 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Dec 24 10:52:40.720143 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-36016d52-8a79-4320-ad53-857f4b938091 tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:52:40.721521 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-36016d52-8a79-4320-ad53-857f4b938091 tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] [instance: ffb09c23-c1d1-4e71-9510-70dd7a07cc40] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:52:40.727861 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-36016d52-8a79-4320-ad53-857f4b938091 tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:52:40.728338 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-36016d52-8a79-4320-ad53-857f4b938091 tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:52:40.729174 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-36016d52-8a79-4320-ad53-857f4b938091 tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:52:40.729612 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-36016d52-8a79-4320-ad53-857f4b938091 tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:52:40.869805 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-36016d52-8a79-4320-ad53-857f4b938091 tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366d62f6b3f4a0487d37e765a3fad02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abda8fd8574437e892913c775910de0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:52:40.877515 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-36016d52-8a79-4320-ad53-857f4b938091 tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] 10.222.0.30 "GET /compute/v2.1/servers/ffb09c23-c1d1-4e71-9510-70dd7a07cc40" status: 200 len: 1259 microversion: 2.1 time: 0.161074 Dec 24 10:52:40.878663 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 582/1162] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:52:40 2021] GET /compute/v2.1/servers/ffb09c23-c1d1-4e71-9510-70dd7a07cc40 => generated 1259 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:52:41.896140 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-9fbf9991-11ae-429e-880d-7fdc0d25c572 tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:52:41.896849 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-9fbf9991-11ae-429e-880d-7fdc0d25c572 tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] [instance: ffb09c23-c1d1-4e71-9510-70dd7a07cc40] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:52:41.903445 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-9fbf9991-11ae-429e-880d-7fdc0d25c572 tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:52:41.903889 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-9fbf9991-11ae-429e-880d-7fdc0d25c572 tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:52:41.904671 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-9fbf9991-11ae-429e-880d-7fdc0d25c572 tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:52:41.905133 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-9fbf9991-11ae-429e-880d-7fdc0d25c572 tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:52:42.039841 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-9fbf9991-11ae-429e-880d-7fdc0d25c572 tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366d62f6b3f4a0487d37e765a3fad02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abda8fd8574437e892913c775910de0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:52:42.047355 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-9fbf9991-11ae-429e-880d-7fdc0d25c572 tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] 10.222.0.30 "GET /compute/v2.1/servers/ffb09c23-c1d1-4e71-9510-70dd7a07cc40" status: 200 len: 1259 microversion: 2.1 time: 0.155809 Dec 24 10:52:42.047928 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 581/1163] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:52:41 2021] GET /compute/v2.1/servers/ffb09c23-c1d1-4e71-9510-70dd7a07cc40 => generated 1259 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:52:42.092450 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-85e1d3e4-8f51-4361-bbe7-4179521085e1 tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:52:42.092450 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-85e1d3e4-8f51-4361-bbe7-4179521085e1 tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] [instance: 8f5b5fe7-eb9b-4c53-a76a-ea25e7910dd0] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:52:42.096794 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-85e1d3e4-8f51-4361-bbe7-4179521085e1 tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:52:42.097283 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-85e1d3e4-8f51-4361-bbe7-4179521085e1 tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:52:42.098068 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-85e1d3e4-8f51-4361-bbe7-4179521085e1 tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:52:42.098499 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-85e1d3e4-8f51-4361-bbe7-4179521085e1 tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:52:42.122247 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-85e1d3e4-8f51-4361-bbe7-4179521085e1 tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] [instance: 8f5b5fe7-eb9b-4c53-a76a-ea25e7910dd0] Going to try to terminate instance {{(pid=123431) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 24 10:52:42.367218 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-76781c8c-d72c-478c-ae4f-c430ea41fe2b tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:52:42.367722 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-76781c8c-d72c-478c-ae4f-c430ea41fe2b tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] [instance: 1e267da4-1e48-4136-babc-656ccd50aae2] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:52:42.373905 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-76781c8c-d72c-478c-ae4f-c430ea41fe2b tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:52:42.374381 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-76781c8c-d72c-478c-ae4f-c430ea41fe2b tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:52:42.375126 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-76781c8c-d72c-478c-ae4f-c430ea41fe2b tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:52:42.375562 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-76781c8c-d72c-478c-ae4f-c430ea41fe2b tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:52:42.388686 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.wsgi [None req-76781c8c-d72c-478c-ae4f-c430ea41fe2b tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] HTTP exception thrown: Instance 1e267da4-1e48-4136-babc-656ccd50aae2 could not be found. Dec 24 10:52:42.389561 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-76781c8c-d72c-478c-ae4f-c430ea41fe2b tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Returning 404 to user: Instance 1e267da4-1e48-4136-babc-656ccd50aae2 could not be found. {{(pid=123432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 24 10:52:42.390425 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-76781c8c-d72c-478c-ae4f-c430ea41fe2b tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] 10.222.0.30 "DELETE /compute/v2.1/servers/1e267da4-1e48-4136-babc-656ccd50aae2" status: 404 len: 111 microversion: 2.1 time: 0.027004 Dec 24 10:52:42.390951 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 582/1164] 10.222.0.30 () {58 vars in 1238 bytes} [Fri Dec 24 10:52:42 2021] DELETE /compute/v2.1/servers/1e267da4-1e48-4136-babc-656ccd50aae2 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Dec 24 10:52:42.403404 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-d8a0cd5a-7c12-4a93-9e84-3a6a147af827 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:52:42.404002 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-d8a0cd5a-7c12-4a93-9e84-3a6a147af827 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] [instance: 1e267da4-1e48-4136-babc-656ccd50aae2] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:52:42.409467 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-d8a0cd5a-7c12-4a93-9e84-3a6a147af827 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:52:42.409933 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-d8a0cd5a-7c12-4a93-9e84-3a6a147af827 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:52:42.410684 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-d8a0cd5a-7c12-4a93-9e84-3a6a147af827 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:52:42.411115 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-d8a0cd5a-7c12-4a93-9e84-3a6a147af827 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:52:42.417143 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-85e1d3e4-8f51-4361-bbe7-4179521085e1 tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] 10.222.0.30 "DELETE /compute/v2.1/servers/8f5b5fe7-eb9b-4c53-a76a-ea25e7910dd0" status: 204 len: 0 microversion: 2.1 time: 0.330690 Dec 24 10:52:42.417733 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 583/1165] 10.222.0.30 () {58 vars in 1238 bytes} [Fri Dec 24 10:52:42 2021] DELETE /compute/v2.1/servers/8f5b5fe7-eb9b-4c53-a76a-ea25e7910dd0 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 24 10:52:42.426036 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-a463056a-d068-4402-b32f-7c50416e9dd1 tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:52:42.426841 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-a463056a-d068-4402-b32f-7c50416e9dd1 tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] [instance: 8f5b5fe7-eb9b-4c53-a76a-ea25e7910dd0] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:52:42.427170 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.wsgi [None req-d8a0cd5a-7c12-4a93-9e84-3a6a147af827 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] HTTP exception thrown: Instance 1e267da4-1e48-4136-babc-656ccd50aae2 could not be found. Dec 24 10:52:42.427755 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-d8a0cd5a-7c12-4a93-9e84-3a6a147af827 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Returning 404 to user: Instance 1e267da4-1e48-4136-babc-656ccd50aae2 could not be found. {{(pid=123432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 24 10:52:42.428565 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-d8a0cd5a-7c12-4a93-9e84-3a6a147af827 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] 10.222.0.30 "GET /compute/v2.1/servers/1e267da4-1e48-4136-babc-656ccd50aae2" status: 404 len: 111 microversion: 2.1 time: 0.028487 Dec 24 10:52:42.429136 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 583/1166] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:52:42 2021] GET /compute/v2.1/servers/1e267da4-1e48-4136-babc-656ccd50aae2 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Dec 24 10:52:42.432987 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-a463056a-d068-4402-b32f-7c50416e9dd1 tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:52:42.433428 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-a463056a-d068-4402-b32f-7c50416e9dd1 tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:52:42.435189 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-a463056a-d068-4402-b32f-7c50416e9dd1 tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:52:42.435623 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-a463056a-d068-4402-b32f-7c50416e9dd1 tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:52:42.567633 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-a463056a-d068-4402-b32f-7c50416e9dd1 tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc441b6f06b44beb2a85f854cf92dd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696f3d18f3af4e0eb5760d829e0c3977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:52:42.574966 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-a463056a-d068-4402-b32f-7c50416e9dd1 tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] 10.222.0.30 "GET /compute/v2.1/servers/8f5b5fe7-eb9b-4c53-a76a-ea25e7910dd0" status: 200 len: 1513 microversion: 2.1 time: 0.152870 Dec 24 10:52:42.575716 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 584/1167] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:52:42 2021] GET /compute/v2.1/servers/8f5b5fe7-eb9b-4c53-a76a-ea25e7910dd0 => generated 1513 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 24 10:52:43.063602 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-cf6ad43a-4e16-40c4-8d7b-fd11a38c2633 tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:52:43.066337 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-cf6ad43a-4e16-40c4-8d7b-fd11a38c2633 tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] [instance: ffb09c23-c1d1-4e71-9510-70dd7a07cc40] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:52:43.071000 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-cf6ad43a-4e16-40c4-8d7b-fd11a38c2633 tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:52:43.071446 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-cf6ad43a-4e16-40c4-8d7b-fd11a38c2633 tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:52:43.072301 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-cf6ad43a-4e16-40c4-8d7b-fd11a38c2633 tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:52:43.072736 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-cf6ad43a-4e16-40c4-8d7b-fd11a38c2633 tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:52:43.203815 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-cf6ad43a-4e16-40c4-8d7b-fd11a38c2633 tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366d62f6b3f4a0487d37e765a3fad02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abda8fd8574437e892913c775910de0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:52:43.211743 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-cf6ad43a-4e16-40c4-8d7b-fd11a38c2633 tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] 10.222.0.30 "GET /compute/v2.1/servers/ffb09c23-c1d1-4e71-9510-70dd7a07cc40" status: 200 len: 1259 microversion: 2.1 time: 0.151813 Dec 24 10:52:43.212303 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 584/1168] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:52:43 2021] GET /compute/v2.1/servers/ffb09c23-c1d1-4e71-9510-70dd7a07cc40 => generated 1259 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:52:43.591737 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-525c91d9-6dd1-49a9-bc60-dc696b9b8876 tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:52:43.592287 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-525c91d9-6dd1-49a9-bc60-dc696b9b8876 tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] [instance: 8f5b5fe7-eb9b-4c53-a76a-ea25e7910dd0] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:52:43.598716 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-525c91d9-6dd1-49a9-bc60-dc696b9b8876 tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:52:43.599297 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-525c91d9-6dd1-49a9-bc60-dc696b9b8876 tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:52:43.600094 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-525c91d9-6dd1-49a9-bc60-dc696b9b8876 tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:52:43.600525 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-525c91d9-6dd1-49a9-bc60-dc696b9b8876 tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:52:43.735084 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-525c91d9-6dd1-49a9-bc60-dc696b9b8876 tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc441b6f06b44beb2a85f854cf92dd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696f3d18f3af4e0eb5760d829e0c3977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:52:43.743218 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-525c91d9-6dd1-49a9-bc60-dc696b9b8876 tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] 10.222.0.30 "GET /compute/v2.1/servers/8f5b5fe7-eb9b-4c53-a76a-ea25e7910dd0" status: 200 len: 1513 microversion: 2.1 time: 0.155245 Dec 24 10:52:43.743808 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 585/1169] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:52:43 2021] GET /compute/v2.1/servers/8f5b5fe7-eb9b-4c53-a76a-ea25e7910dd0 => generated 1513 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:52:43.746197 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-440aa062-1c77-4ca6-98c6-bb69cb2532e4 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:52:43.746758 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-440aa062-1c77-4ca6-98c6-bb69cb2532e4 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] [instance: 9330dbb8-edad-4d54-afeb-8badc464250d] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:52:43.752566 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-440aa062-1c77-4ca6-98c6-bb69cb2532e4 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:52:43.753049 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-440aa062-1c77-4ca6-98c6-bb69cb2532e4 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:52:43.753824 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-440aa062-1c77-4ca6-98c6-bb69cb2532e4 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:52:43.754252 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-440aa062-1c77-4ca6-98c6-bb69cb2532e4 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:52:43.767249 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.wsgi [None req-440aa062-1c77-4ca6-98c6-bb69cb2532e4 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] HTTP exception thrown: Instance 9330dbb8-edad-4d54-afeb-8badc464250d could not be found. Dec 24 10:52:43.767823 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-440aa062-1c77-4ca6-98c6-bb69cb2532e4 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Returning 404 to user: Instance 9330dbb8-edad-4d54-afeb-8badc464250d could not be found. {{(pid=123432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 24 10:52:43.768625 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-440aa062-1c77-4ca6-98c6-bb69cb2532e4 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] 10.222.0.30 "DELETE /compute/v2.1/servers/9330dbb8-edad-4d54-afeb-8badc464250d" status: 404 len: 111 microversion: 2.1 time: 0.026301 Dec 24 10:52:43.769183 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 585/1170] 10.222.0.30 () {58 vars in 1238 bytes} [Fri Dec 24 10:52:43 2021] DELETE /compute/v2.1/servers/9330dbb8-edad-4d54-afeb-8badc464250d => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Dec 24 10:52:43.776799 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-ad809348-ff46-4d01-90be-7780ff2d0161 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:52:43.777436 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-ad809348-ff46-4d01-90be-7780ff2d0161 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] [instance: 9330dbb8-edad-4d54-afeb-8badc464250d] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:52:43.783225 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-ad809348-ff46-4d01-90be-7780ff2d0161 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:52:43.783657 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-ad809348-ff46-4d01-90be-7780ff2d0161 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:52:43.784429 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-ad809348-ff46-4d01-90be-7780ff2d0161 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:52:43.784885 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-ad809348-ff46-4d01-90be-7780ff2d0161 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:52:43.799713 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.wsgi [None req-ad809348-ff46-4d01-90be-7780ff2d0161 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] HTTP exception thrown: Instance 9330dbb8-edad-4d54-afeb-8badc464250d could not be found. Dec 24 10:52:43.800295 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-ad809348-ff46-4d01-90be-7780ff2d0161 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] Returning 404 to user: Instance 9330dbb8-edad-4d54-afeb-8badc464250d could not be found. {{(pid=123431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 24 10:52:43.801155 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-ad809348-ff46-4d01-90be-7780ff2d0161 tempest-AttachVolumeTestJSON-1203053852 tempest-AttachVolumeTestJSON-1203053852-project] 10.222.0.30 "GET /compute/v2.1/servers/9330dbb8-edad-4d54-afeb-8badc464250d" status: 404 len: 111 microversion: 2.1 time: 0.027967 Dec 24 10:52:43.801924 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 586/1171] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:52:43 2021] GET /compute/v2.1/servers/9330dbb8-edad-4d54-afeb-8badc464250d => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 24 10:52:44.228236 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-f3d9d5d6-3205-4502-acfe-554349317f7f tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:52:44.228889 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-f3d9d5d6-3205-4502-acfe-554349317f7f tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] [instance: ffb09c23-c1d1-4e71-9510-70dd7a07cc40] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:52:44.235257 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-f3d9d5d6-3205-4502-acfe-554349317f7f tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:52:44.235708 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-f3d9d5d6-3205-4502-acfe-554349317f7f tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:52:44.236504 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-f3d9d5d6-3205-4502-acfe-554349317f7f tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:52:44.236968 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-f3d9d5d6-3205-4502-acfe-554349317f7f tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:52:44.465683 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-f3d9d5d6-3205-4502-acfe-554349317f7f tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366d62f6b3f4a0487d37e765a3fad02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abda8fd8574437e892913c775910de0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:52:44.473304 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-f3d9d5d6-3205-4502-acfe-554349317f7f tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] 10.222.0.30 "GET /compute/v2.1/servers/ffb09c23-c1d1-4e71-9510-70dd7a07cc40" status: 200 len: 1259 microversion: 2.1 time: 0.249570 Dec 24 10:52:44.483178 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 586/1172] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:52:44 2021] GET /compute/v2.1/servers/ffb09c23-c1d1-4e71-9510-70dd7a07cc40 => generated 1259 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:52:44.742280 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [req-0268eec0-4be2-442d-89d0-6c92f4b8c019 req-e0ba4c60-2009-4502-a660-f9ecf076994c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f5b5fe7-eb9b-4c53-a76a-ea25e7910dd0", "name": "network-vif-deleted", "tag": "42a1a6bb-662d-484d-8547-95806531bcb0"}]} {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:52:44.744032 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 10:52:44.744032 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: warnings.warn(msg) Dec 24 10:52:44.751400 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [req-0268eec0-4be2-442d-89d0-6c92f4b8c019 req-e0ba4c60-2009-4502-a660-f9ecf076994c service nova] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:52:44.755835 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [req-0268eec0-4be2-442d-89d0-6c92f4b8c019 req-e0ba4c60-2009-4502-a660-f9ecf076994c service nova] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:52:44.760680 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-dafbd9e2-2742-4181-a773-fc098bd7c64a tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:52:44.761321 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-dafbd9e2-2742-4181-a773-fc098bd7c64a tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] [instance: 8f5b5fe7-eb9b-4c53-a76a-ea25e7910dd0] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:52:44.767722 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-dafbd9e2-2742-4181-a773-fc098bd7c64a tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:52:44.768393 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-dafbd9e2-2742-4181-a773-fc098bd7c64a tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:52:44.769324 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-dafbd9e2-2742-4181-a773-fc098bd7c64a tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:52:44.770362 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-dafbd9e2-2742-4181-a773-fc098bd7c64a tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:52:44.770490 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.compute.server_external_events [req-0268eec0-4be2-442d-89d0-6c92f4b8c019 req-e0ba4c60-2009-4502-a660-f9ecf076994c service nova] Creating event network-vif-deleted:42a1a6bb-662d-484d-8547-95806531bcb0 for instance 8f5b5fe7-eb9b-4c53-a76a-ea25e7910dd0 on hv-cinder-81644 Dec 24 10:52:44.776208 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [req-0268eec0-4be2-442d-89d0-6c92f4b8c019 req-e0ba4c60-2009-4502-a660-f9ecf076994c service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037929 Dec 24 10:52:44.777711 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 587/1173] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Dec 24 10:52:44 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 10:52:44.851828 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-dafbd9e2-2742-4181-a773-fc098bd7c64a tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc441b6f06b44beb2a85f854cf92dd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696f3d18f3af4e0eb5760d829e0c3977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:52:44.860519 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-dafbd9e2-2742-4181-a773-fc098bd7c64a tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] 10.222.0.30 "GET /compute/v2.1/servers/8f5b5fe7-eb9b-4c53-a76a-ea25e7910dd0" status: 200 len: 1471 microversion: 2.1 time: 0.104188 Dec 24 10:52:44.861493 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 587/1174] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:52:44 2021] GET /compute/v2.1/servers/8f5b5fe7-eb9b-4c53-a76a-ea25e7910dd0 => generated 1471 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 24 10:52:45.490963 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-7bab9141-4f5f-44f6-bd22-495a6a41a3a9 tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:52:45.491930 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-7bab9141-4f5f-44f6-bd22-495a6a41a3a9 tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] [instance: ffb09c23-c1d1-4e71-9510-70dd7a07cc40] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:52:45.498183 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-7bab9141-4f5f-44f6-bd22-495a6a41a3a9 tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:52:45.498627 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-7bab9141-4f5f-44f6-bd22-495a6a41a3a9 tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:52:45.499411 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-7bab9141-4f5f-44f6-bd22-495a6a41a3a9 tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:52:45.499838 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-7bab9141-4f5f-44f6-bd22-495a6a41a3a9 tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:52:45.642765 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-7bab9141-4f5f-44f6-bd22-495a6a41a3a9 tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366d62f6b3f4a0487d37e765a3fad02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abda8fd8574437e892913c775910de0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:52:45.651676 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-7bab9141-4f5f-44f6-bd22-495a6a41a3a9 tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] 10.222.0.30 "GET /compute/v2.1/servers/ffb09c23-c1d1-4e71-9510-70dd7a07cc40" status: 200 len: 1259 microversion: 2.1 time: 0.164815 Dec 24 10:52:45.652300 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 588/1175] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:52:45 2021] GET /compute/v2.1/servers/ffb09c23-c1d1-4e71-9510-70dd7a07cc40 => generated 1259 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:52:45.884097 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-cc6ffacd-ae2a-4b33-aec1-f9c052e44554 tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:52:45.884689 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-cc6ffacd-ae2a-4b33-aec1-f9c052e44554 tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] [instance: 8f5b5fe7-eb9b-4c53-a76a-ea25e7910dd0] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:52:45.892202 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-cc6ffacd-ae2a-4b33-aec1-f9c052e44554 tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:52:45.892477 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-cc6ffacd-ae2a-4b33-aec1-f9c052e44554 tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:52:45.893307 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-cc6ffacd-ae2a-4b33-aec1-f9c052e44554 tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:52:45.893738 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-cc6ffacd-ae2a-4b33-aec1-f9c052e44554 tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:52:45.930775 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-cc6ffacd-ae2a-4b33-aec1-f9c052e44554 tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:52:45.931284 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-cc6ffacd-ae2a-4b33-aec1-f9c052e44554 tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:52:45.931905 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.objects.instance [None req-cc6ffacd-ae2a-4b33-aec1-f9c052e44554 tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] Lazy-loading 'fault' on Instance uuid 8f5b5fe7-eb9b-4c53-a76a-ea25e7910dd0 {{(pid=123432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 24 10:52:45.984801 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-a6e6f7f1-20bb-4c24-bb62-7abe4b3f96e1 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:52:45.986581 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-a6e6f7f1-20bb-4c24-bb62-7abe4b3f96e1 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] [instance: d2c0f276-f763-4337-a5dd-0c328c8c2e73] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:52:45.993869 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-a6e6f7f1-20bb-4c24-bb62-7abe4b3f96e1 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:52:45.999614 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-a6e6f7f1-20bb-4c24-bb62-7abe4b3f96e1 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:52:45.999614 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-a6e6f7f1-20bb-4c24-bb62-7abe4b3f96e1 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:52:45.999614 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-a6e6f7f1-20bb-4c24-bb62-7abe4b3f96e1 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:52:46.006102 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-cc6ffacd-ae2a-4b33-aec1-f9c052e44554 tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc441b6f06b44beb2a85f854cf92dd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696f3d18f3af4e0eb5760d829e0c3977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:52:46.015797 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-cc6ffacd-ae2a-4b33-aec1-f9c052e44554 tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] 10.222.0.30 "GET /compute/v2.1/servers/8f5b5fe7-eb9b-4c53-a76a-ea25e7910dd0" status: 200 len: 1308 microversion: 2.1 time: 0.141725 Dec 24 10:52:46.018532 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 588/1176] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:52:45 2021] GET /compute/v2.1/servers/8f5b5fe7-eb9b-4c53-a76a-ea25e7910dd0 => generated 1308 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:52:46.036761 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-a6e6f7f1-20bb-4c24-bb62-7abe4b3f96e1 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] 10.222.0.30 "GET /compute/v2.1/servers/d2c0f276-f763-4337-a5dd-0c328c8c2e73/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.055712 Dec 24 10:52:46.037794 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 589/1177] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Dec 24 10:52:45 2021] GET /compute/v2.1/servers/d2c0f276-f763-4337-a5dd-0c328c8c2e73/os-volume_attachments => generated 25 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:52:46.100383 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-5e90157a-77da-470b-b514-8f8128208498 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:52:46.100948 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-5e90157a-77da-470b-b514-8f8128208498 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] [instance: d2c0f276-f763-4337-a5dd-0c328c8c2e73] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:52:46.107378 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-5e90157a-77da-470b-b514-8f8128208498 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:52:46.107826 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-5e90157a-77da-470b-b514-8f8128208498 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:52:46.108638 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-5e90157a-77da-470b-b514-8f8128208498 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:52:46.109097 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-5e90157a-77da-470b-b514-8f8128208498 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:52:46.135346 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-5e90157a-77da-470b-b514-8f8128208498 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] [instance: d2c0f276-f763-4337-a5dd-0c328c8c2e73] Going to try to terminate instance {{(pid=123432) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 24 10:52:46.590033 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-5e90157a-77da-470b-b514-8f8128208498 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] 10.222.0.30 "DELETE /compute/v2.1/servers/d2c0f276-f763-4337-a5dd-0c328c8c2e73" status: 204 len: 0 microversion: 2.20 time: 0.493351 Dec 24 10:52:46.590710 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 589/1178] 10.222.0.30 () {60 vars in 1279 bytes} [Fri Dec 24 10:52:46 2021] DELETE /compute/v2.1/servers/d2c0f276-f763-4337-a5dd-0c328c8c2e73 => generated 0 bytes in 495 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Dec 24 10:52:46.599109 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-dcab9ee1-b3b7-4f2d-8e5d-764571465896 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:52:46.600954 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-dcab9ee1-b3b7-4f2d-8e5d-764571465896 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] [instance: d2c0f276-f763-4337-a5dd-0c328c8c2e73] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:52:46.606910 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-dcab9ee1-b3b7-4f2d-8e5d-764571465896 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:52:46.607356 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-dcab9ee1-b3b7-4f2d-8e5d-764571465896 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:52:46.608140 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-dcab9ee1-b3b7-4f2d-8e5d-764571465896 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:52:46.608573 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-dcab9ee1-b3b7-4f2d-8e5d-764571465896 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:52:46.668514 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-351b93ef-752e-4a61-a404-db67a2b1f402 tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:52:46.669922 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-351b93ef-752e-4a61-a404-db67a2b1f402 tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] [instance: ffb09c23-c1d1-4e71-9510-70dd7a07cc40] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:52:46.680670 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-351b93ef-752e-4a61-a404-db67a2b1f402 tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:52:46.681149 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-351b93ef-752e-4a61-a404-db67a2b1f402 tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:52:46.684148 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-351b93ef-752e-4a61-a404-db67a2b1f402 tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:52:46.690958 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-351b93ef-752e-4a61-a404-db67a2b1f402 tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:52:46.758601 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-dcab9ee1-b3b7-4f2d-8e5d-764571465896 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:52:46.768363 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-dcab9ee1-b3b7-4f2d-8e5d-764571465896 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:52:46.770044 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-dcab9ee1-b3b7-4f2d-8e5d-764571465896 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:52:46.771290 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-dcab9ee1-b3b7-4f2d-8e5d-764571465896 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] 10.222.0.30 "GET /compute/v2.1/servers/d2c0f276-f763-4337-a5dd-0c328c8c2e73" status: 200 len: 1723 microversion: 2.20 time: 0.176172 Dec 24 10:52:46.771935 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 590/1179] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Dec 24 10:52:46 2021] GET /compute/v2.1/servers/d2c0f276-f763-4337-a5dd-0c328c8c2e73 => generated 1723 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 10:52:46.777058 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [req-3c4d3aa8-82ec-4687-83a2-1bf24fe11104 req-7d61b732-c45d-4958-a473-d71fc161a66d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ffb09c23-c1d1-4e71-9510-70dd7a07cc40", "name": "network-vif-plugged", "status": "completed", "tag": "d66f0143-a5b5-43e9-9377-65eedc43836e"}]} {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:52:46.778624 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 10:52:46.778624 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: warnings.warn(msg) Dec 24 10:52:46.785737 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [req-3c4d3aa8-82ec-4687-83a2-1bf24fe11104 req-7d61b732-c45d-4958-a473-d71fc161a66d service nova] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:52:46.786252 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [req-3c4d3aa8-82ec-4687-83a2-1bf24fe11104 req-7d61b732-c45d-4958-a473-d71fc161a66d service nova] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:52:46.797965 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.compute.server_external_events [req-3c4d3aa8-82ec-4687-83a2-1bf24fe11104 req-7d61b732-c45d-4958-a473-d71fc161a66d service nova] Creating event network-vif-plugged:d66f0143-a5b5-43e9-9377-65eedc43836e for instance ffb09c23-c1d1-4e71-9510-70dd7a07cc40 on hv-cinder-81644 Dec 24 10:52:46.813695 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [req-3c4d3aa8-82ec-4687-83a2-1bf24fe11104 req-7d61b732-c45d-4958-a473-d71fc161a66d service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039674 Dec 24 10:52:46.818700 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 591/1180] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Dec 24 10:52:46 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 10:52:46.907333 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-351b93ef-752e-4a61-a404-db67a2b1f402 tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366d62f6b3f4a0487d37e765a3fad02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abda8fd8574437e892913c775910de0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:52:46.916488 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-351b93ef-752e-4a61-a404-db67a2b1f402 tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] 10.222.0.30 "GET /compute/v2.1/servers/ffb09c23-c1d1-4e71-9510-70dd7a07cc40" status: 200 len: 1259 microversion: 2.1 time: 0.251943 Dec 24 10:52:46.917232 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 590/1181] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:52:46 2021] GET /compute/v2.1/servers/ffb09c23-c1d1-4e71-9510-70dd7a07cc40 => generated 1259 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 24 10:52:47.042934 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-339aa291-f634-4eff-83e2-185059480b08 tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:52:47.044392 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-339aa291-f634-4eff-83e2-185059480b08 tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] [instance: 8f5b5fe7-eb9b-4c53-a76a-ea25e7910dd0] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:52:47.051611 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-339aa291-f634-4eff-83e2-185059480b08 tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:52:47.052387 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-339aa291-f634-4eff-83e2-185059480b08 tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:52:47.054124 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-339aa291-f634-4eff-83e2-185059480b08 tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:52:47.054943 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-339aa291-f634-4eff-83e2-185059480b08 tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:52:47.079537 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.wsgi [None req-339aa291-f634-4eff-83e2-185059480b08 tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] HTTP exception thrown: Instance 8f5b5fe7-eb9b-4c53-a76a-ea25e7910dd0 could not be found. Dec 24 10:52:47.080678 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-339aa291-f634-4eff-83e2-185059480b08 tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] Returning 404 to user: Instance 8f5b5fe7-eb9b-4c53-a76a-ea25e7910dd0 could not be found. {{(pid=123431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 24 10:52:47.082508 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-339aa291-f634-4eff-83e2-185059480b08 tempest-VolumesSnapshotTestJSON-564645560 tempest-VolumesSnapshotTestJSON-564645560-project] 10.222.0.30 "GET /compute/v2.1/servers/8f5b5fe7-eb9b-4c53-a76a-ea25e7910dd0" status: 404 len: 111 microversion: 2.1 time: 0.049336 Dec 24 10:52:47.099328 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 592/1182] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:52:47 2021] GET /compute/v2.1/servers/8f5b5fe7-eb9b-4c53-a76a-ea25e7910dd0 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 24 10:52:47.791700 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-0dc082b3-44fc-4ccc-94d0-286c8ecda6c6 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:52:47.792588 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-0dc082b3-44fc-4ccc-94d0-286c8ecda6c6 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] [instance: d2c0f276-f763-4337-a5dd-0c328c8c2e73] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:52:47.800034 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-0dc082b3-44fc-4ccc-94d0-286c8ecda6c6 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:52:47.801000 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-0dc082b3-44fc-4ccc-94d0-286c8ecda6c6 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:52:47.801581 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-0dc082b3-44fc-4ccc-94d0-286c8ecda6c6 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:52:47.802290 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-0dc082b3-44fc-4ccc-94d0-286c8ecda6c6 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:52:47.933898 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-9628eb6f-8754-4af8-8e82-5abd0b9c1e2f tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:52:47.935504 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-9628eb6f-8754-4af8-8e82-5abd0b9c1e2f tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] [instance: ffb09c23-c1d1-4e71-9510-70dd7a07cc40] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:52:47.948843 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-9628eb6f-8754-4af8-8e82-5abd0b9c1e2f tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:52:47.949358 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-9628eb6f-8754-4af8-8e82-5abd0b9c1e2f tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:52:47.950422 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-9628eb6f-8754-4af8-8e82-5abd0b9c1e2f tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:52:47.950862 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-9628eb6f-8754-4af8-8e82-5abd0b9c1e2f tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:52:48.032585 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-0dc082b3-44fc-4ccc-94d0-286c8ecda6c6 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:52:48.062044 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-0dc082b3-44fc-4ccc-94d0-286c8ecda6c6 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:52:48.062044 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-0dc082b3-44fc-4ccc-94d0-286c8ecda6c6 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:52:48.062044 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-0dc082b3-44fc-4ccc-94d0-286c8ecda6c6 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] 10.222.0.30 "GET /compute/v2.1/servers/d2c0f276-f763-4337-a5dd-0c328c8c2e73" status: 200 len: 1723 microversion: 2.20 time: 0.267141 Dec 24 10:52:48.062336 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 591/1183] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Dec 24 10:52:47 2021] GET /compute/v2.1/servers/d2c0f276-f763-4337-a5dd-0c328c8c2e73 => generated 1723 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 10:52:48.099713 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-9628eb6f-8754-4af8-8e82-5abd0b9c1e2f tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366d62f6b3f4a0487d37e765a3fad02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abda8fd8574437e892913c775910de0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:52:48.108921 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-9628eb6f-8754-4af8-8e82-5abd0b9c1e2f tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] 10.222.0.30 "GET /compute/v2.1/servers/ffb09c23-c1d1-4e71-9510-70dd7a07cc40" status: 200 len: 1259 microversion: 2.1 time: 0.178705 Dec 24 10:52:48.109530 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 593/1184] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:52:47 2021] GET /compute/v2.1/servers/ffb09c23-c1d1-4e71-9510-70dd7a07cc40 => generated 1259 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 24 10:52:49.076022 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-bbaa00c2-2c91-45f9-a9a5-f6dfa64f6a5e tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:52:49.076631 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-bbaa00c2-2c91-45f9-a9a5-f6dfa64f6a5e tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] [instance: d2c0f276-f763-4337-a5dd-0c328c8c2e73] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:52:49.083632 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-bbaa00c2-2c91-45f9-a9a5-f6dfa64f6a5e tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:52:49.084408 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-bbaa00c2-2c91-45f9-a9a5-f6dfa64f6a5e tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:52:49.086053 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-bbaa00c2-2c91-45f9-a9a5-f6dfa64f6a5e tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:52:49.086609 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-bbaa00c2-2c91-45f9-a9a5-f6dfa64f6a5e tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:52:49.127643 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-3e45396a-8651-47f2-8b68-ae5a231d155f tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:52:49.128209 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-3e45396a-8651-47f2-8b68-ae5a231d155f tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] [instance: ffb09c23-c1d1-4e71-9510-70dd7a07cc40] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:52:49.147945 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-3e45396a-8651-47f2-8b68-ae5a231d155f tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:52:49.148404 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-3e45396a-8651-47f2-8b68-ae5a231d155f tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:52:49.149264 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-3e45396a-8651-47f2-8b68-ae5a231d155f tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:52:49.149715 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-3e45396a-8651-47f2-8b68-ae5a231d155f tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:52:49.217643 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-bbaa00c2-2c91-45f9-a9a5-f6dfa64f6a5e tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:52:49.227436 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-bbaa00c2-2c91-45f9-a9a5-f6dfa64f6a5e tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:52:49.228999 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-bbaa00c2-2c91-45f9-a9a5-f6dfa64f6a5e tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:52:49.230163 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-bbaa00c2-2c91-45f9-a9a5-f6dfa64f6a5e tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] 10.222.0.30 "GET /compute/v2.1/servers/d2c0f276-f763-4337-a5dd-0c328c8c2e73" status: 200 len: 1655 microversion: 2.20 time: 0.157920 Dec 24 10:52:49.230725 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 592/1185] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Dec 24 10:52:49 2021] GET /compute/v2.1/servers/d2c0f276-f763-4337-a5dd-0c328c8c2e73 => generated 1655 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 10:52:49.441081 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-3e45396a-8651-47f2-8b68-ae5a231d155f tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366d62f6b3f4a0487d37e765a3fad02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abda8fd8574437e892913c775910de0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:52:49.444883 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-3e45396a-8651-47f2-8b68-ae5a231d155f tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] 10.222.0.30 "GET /compute/v2.1/servers/ffb09c23-c1d1-4e71-9510-70dd7a07cc40" status: 200 len: 1442 microversion: 2.1 time: 0.322098 Dec 24 10:52:49.446014 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 594/1186] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:52:49 2021] GET /compute/v2.1/servers/ffb09c23-c1d1-4e71-9510-70dd7a07cc40 => generated 1442 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:52:49.461506 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-d8e5c899-dbf7-40db-8131-6b4c9dabf66d tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:52:49.462125 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-d8e5c899-dbf7-40db-8131-6b4c9dabf66d tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] [instance: ffb09c23-c1d1-4e71-9510-70dd7a07cc40] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:52:49.467847 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-d8e5c899-dbf7-40db-8131-6b4c9dabf66d tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:52:49.468296 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-d8e5c899-dbf7-40db-8131-6b4c9dabf66d tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:52:49.469115 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-d8e5c899-dbf7-40db-8131-6b4c9dabf66d tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:52:49.469546 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-d8e5c899-dbf7-40db-8131-6b4c9dabf66d tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:52:49.599348 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-d8e5c899-dbf7-40db-8131-6b4c9dabf66d tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366d62f6b3f4a0487d37e765a3fad02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abda8fd8574437e892913c775910de0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:52:49.618916 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-d8e5c899-dbf7-40db-8131-6b4c9dabf66d tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] 10.222.0.30 "GET /compute/v2.1/servers/ffb09c23-c1d1-4e71-9510-70dd7a07cc40" status: 200 len: 1442 microversion: 2.1 time: 0.161031 Dec 24 10:52:49.620194 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 593/1187] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:52:49 2021] GET /compute/v2.1/servers/ffb09c23-c1d1-4e71-9510-70dd7a07cc40 => generated 1442 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:52:49.674026 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [req-cfeb4ae8-9a4b-4a29-8400-bf6045c12879 req-d312eaf5-7b3e-4066-829a-2354177a0702 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2c0f276-f763-4337-a5dd-0c328c8c2e73", "name": "network-vif-deleted", "tag": "4043d4f5-4811-4ba4-8723-4f04e5548d1c"}]} {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:52:49.677696 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 10:52:49.677696 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: warnings.warn(msg) Dec 24 10:52:49.696354 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [req-cfeb4ae8-9a4b-4a29-8400-bf6045c12879 req-d312eaf5-7b3e-4066-829a-2354177a0702 service nova] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:52:49.697424 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [req-cfeb4ae8-9a4b-4a29-8400-bf6045c12879 req-d312eaf5-7b3e-4066-829a-2354177a0702 service nova] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:52:49.716372 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.compute.server_external_events [req-cfeb4ae8-9a4b-4a29-8400-bf6045c12879 req-d312eaf5-7b3e-4066-829a-2354177a0702 service nova] Creating event network-vif-deleted:4043d4f5-4811-4ba4-8723-4f04e5548d1c for instance d2c0f276-f763-4337-a5dd-0c328c8c2e73 on hv-cinder-81644 Dec 24 10:52:49.723003 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [req-cfeb4ae8-9a4b-4a29-8400-bf6045c12879 req-d312eaf5-7b3e-4066-829a-2354177a0702 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052859 Dec 24 10:52:49.724765 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 595/1188] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Dec 24 10:52:49 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 10:52:50.249080 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-9e7ff42e-8639-4c9e-8608-cf8e871ac0a8 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:52:50.251198 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-9e7ff42e-8639-4c9e-8608-cf8e871ac0a8 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] [instance: d2c0f276-f763-4337-a5dd-0c328c8c2e73] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:52:50.258985 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-9e7ff42e-8639-4c9e-8608-cf8e871ac0a8 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:52:50.259557 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-9e7ff42e-8639-4c9e-8608-cf8e871ac0a8 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:52:50.260442 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-9e7ff42e-8639-4c9e-8608-cf8e871ac0a8 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:52:50.266374 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-9e7ff42e-8639-4c9e-8608-cf8e871ac0a8 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:52:50.316098 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-9e7ff42e-8639-4c9e-8608-cf8e871ac0a8 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:52:50.316866 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-9e7ff42e-8639-4c9e-8608-cf8e871ac0a8 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:52:50.317359 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.objects.instance [None req-9e7ff42e-8639-4c9e-8608-cf8e871ac0a8 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lazy-loading 'fault' on Instance uuid d2c0f276-f763-4337-a5dd-0c328c8c2e73 {{(pid=123432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 24 10:52:50.372833 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-9e7ff42e-8639-4c9e-8608-cf8e871ac0a8 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:52:50.380751 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-9e7ff42e-8639-4c9e-8608-cf8e871ac0a8 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:52:50.382864 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-9e7ff42e-8639-4c9e-8608-cf8e871ac0a8 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:52:50.384248 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-9e7ff42e-8639-4c9e-8608-cf8e871ac0a8 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] 10.222.0.30 "GET /compute/v2.1/servers/d2c0f276-f763-4337-a5dd-0c328c8c2e73" status: 200 len: 1371 microversion: 2.20 time: 0.139404 Dec 24 10:52:50.384849 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 594/1189] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Dec 24 10:52:50 2021] GET /compute/v2.1/servers/d2c0f276-f763-4337-a5dd-0c328c8c2e73 => generated 1371 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 10:52:51.406442 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-4182fe62-2004-41ac-af90-a309b006409e tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:52:51.406442 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-4182fe62-2004-41ac-af90-a309b006409e tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] [instance: d2c0f276-f763-4337-a5dd-0c328c8c2e73] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:52:51.412350 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-4182fe62-2004-41ac-af90-a309b006409e tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:52:51.413407 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-4182fe62-2004-41ac-af90-a309b006409e tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:52:51.414263 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-4182fe62-2004-41ac-af90-a309b006409e tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:52:51.414773 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-4182fe62-2004-41ac-af90-a309b006409e tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:52:51.450636 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-4182fe62-2004-41ac-af90-a309b006409e tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:52:51.451166 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-4182fe62-2004-41ac-af90-a309b006409e tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:52:51.451687 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.objects.instance [None req-4182fe62-2004-41ac-af90-a309b006409e tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lazy-loading 'fault' on Instance uuid d2c0f276-f763-4337-a5dd-0c328c8c2e73 {{(pid=123431) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 24 10:52:51.517583 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-4182fe62-2004-41ac-af90-a309b006409e tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:52:51.523907 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-4182fe62-2004-41ac-af90-a309b006409e tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:52:51.525439 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-4182fe62-2004-41ac-af90-a309b006409e tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e695a7efa1c1465b99a8fb0b434a59f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b52b70f10024974af39a32f1a1a2502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:52:51.526590 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-4182fe62-2004-41ac-af90-a309b006409e tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] 10.222.0.30 "GET /compute/v2.1/servers/d2c0f276-f763-4337-a5dd-0c328c8c2e73" status: 200 len: 1371 microversion: 2.20 time: 0.127509 Dec 24 10:52:51.527470 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 596/1190] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Dec 24 10:52:51 2021] GET /compute/v2.1/servers/d2c0f276-f763-4337-a5dd-0c328c8c2e73 => generated 1371 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 10:52:52.415399 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [req-bbcb0e86-1d36-4092-b01b-36fe03a1982a req-f1328ba2-fce7-4012-a031-735fbac2bc63 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ffb09c23-c1d1-4e71-9510-70dd7a07cc40", "tag": "d66f0143-a5b5-43e9-9377-65eedc43836e"}]} {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:52:52.417572 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 10:52:52.417572 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: warnings.warn(msg) Dec 24 10:52:52.425189 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [req-bbcb0e86-1d36-4092-b01b-36fe03a1982a req-f1328ba2-fce7-4012-a031-735fbac2bc63 service nova] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:52:52.425635 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [req-bbcb0e86-1d36-4092-b01b-36fe03a1982a req-f1328ba2-fce7-4012-a031-735fbac2bc63 service nova] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:52:52.437269 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.compute.server_external_events [req-bbcb0e86-1d36-4092-b01b-36fe03a1982a req-f1328ba2-fce7-4012-a031-735fbac2bc63 service nova] Creating event network-changed:d66f0143-a5b5-43e9-9377-65eedc43836e for instance ffb09c23-c1d1-4e71-9510-70dd7a07cc40 on hv-cinder-81644 Dec 24 10:52:52.443132 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [req-bbcb0e86-1d36-4092-b01b-36fe03a1982a req-f1328ba2-fce7-4012-a031-735fbac2bc63 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031875 Dec 24 10:52:52.444099 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 595/1191] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Dec 24 10:52:52 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 10:52:52.544361 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-c888a49a-3cc4-4159-b6f7-c345cb09221d tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:52:52.545090 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-c888a49a-3cc4-4159-b6f7-c345cb09221d tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] [instance: d2c0f276-f763-4337-a5dd-0c328c8c2e73] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:52:52.551748 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-c888a49a-3cc4-4159-b6f7-c345cb09221d tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:52:52.552130 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-c888a49a-3cc4-4159-b6f7-c345cb09221d tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:52:52.553073 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-c888a49a-3cc4-4159-b6f7-c345cb09221d tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:52:52.553543 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-c888a49a-3cc4-4159-b6f7-c345cb09221d tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:52:52.567961 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.wsgi [None req-c888a49a-3cc4-4159-b6f7-c345cb09221d tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] HTTP exception thrown: Instance d2c0f276-f763-4337-a5dd-0c328c8c2e73 could not be found. Dec 24 10:52:52.574952 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-c888a49a-3cc4-4159-b6f7-c345cb09221d tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Returning 404 to user: Instance d2c0f276-f763-4337-a5dd-0c328c8c2e73 could not be found. {{(pid=123431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 24 10:52:52.574952 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-c888a49a-3cc4-4159-b6f7-c345cb09221d tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] 10.222.0.30 "GET /compute/v2.1/servers/d2c0f276-f763-4337-a5dd-0c328c8c2e73" status: 404 len: 111 microversion: 2.20 time: 0.029347 Dec 24 10:52:52.574952 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 597/1192] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Dec 24 10:52:52 2021] GET /compute/v2.1/servers/d2c0f276-f763-4337-a5dd-0c328c8c2e73 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Dec 24 10:52:52.579414 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-1781b1c6-8842-4e4a-a940-6cf3c71b1bde tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Calling method '.version_select at 0x7f1899a65700>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:52:52.855881 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-1781b1c6-8842-4e4a-a940-6cf3c71b1bde tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-161970771" status: 204 len: 0 microversion: 2.20 time: 0.273716 Dec 24 10:52:52.855881 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 596/1193] 10.222.0.30 () {60 vars in 1258 bytes} [Fri Dec 24 10:52:52 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-161970771 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Dec 24 10:52:55.394277 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-08fec8ad-c861-43d8-96f4-94d59df594f3 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:52:55.394821 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-08fec8ad-c861-43d8-96f4-94d59df594f3 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] [instance: d2c0f276-f763-4337-a5dd-0c328c8c2e73] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:52:55.401938 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-08fec8ad-c861-43d8-96f4-94d59df594f3 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:52:55.402484 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-08fec8ad-c861-43d8-96f4-94d59df594f3 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:52:55.403267 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-08fec8ad-c861-43d8-96f4-94d59df594f3 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:52:55.403702 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-08fec8ad-c861-43d8-96f4-94d59df594f3 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:52:55.417337 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.wsgi [None req-08fec8ad-c861-43d8-96f4-94d59df594f3 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] HTTP exception thrown: Instance d2c0f276-f763-4337-a5dd-0c328c8c2e73 could not be found. Dec 24 10:52:55.417920 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-08fec8ad-c861-43d8-96f4-94d59df594f3 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Returning 404 to user: Instance d2c0f276-f763-4337-a5dd-0c328c8c2e73 could not be found. {{(pid=123431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 24 10:52:55.418739 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-08fec8ad-c861-43d8-96f4-94d59df594f3 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] 10.222.0.30 "DELETE /compute/v2.1/servers/d2c0f276-f763-4337-a5dd-0c328c8c2e73" status: 404 len: 111 microversion: 2.20 time: 0.028288 Dec 24 10:52:55.419264 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 598/1194] 10.222.0.30 () {60 vars in 1279 bytes} [Fri Dec 24 10:52:55 2021] DELETE /compute/v2.1/servers/d2c0f276-f763-4337-a5dd-0c328c8c2e73 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Dec 24 10:52:55.427516 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-74f436f5-40e0-4ad9-b25b-1e38808a3bb3 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:52:55.428228 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-74f436f5-40e0-4ad9-b25b-1e38808a3bb3 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] [instance: d2c0f276-f763-4337-a5dd-0c328c8c2e73] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:52:55.434755 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-74f436f5-40e0-4ad9-b25b-1e38808a3bb3 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:52:55.435206 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-74f436f5-40e0-4ad9-b25b-1e38808a3bb3 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:52:55.435981 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-74f436f5-40e0-4ad9-b25b-1e38808a3bb3 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:52:55.436418 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-74f436f5-40e0-4ad9-b25b-1e38808a3bb3 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:52:55.449681 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.wsgi [None req-74f436f5-40e0-4ad9-b25b-1e38808a3bb3 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] HTTP exception thrown: Instance d2c0f276-f763-4337-a5dd-0c328c8c2e73 could not be found. Dec 24 10:52:55.450267 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-74f436f5-40e0-4ad9-b25b-1e38808a3bb3 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Returning 404 to user: Instance d2c0f276-f763-4337-a5dd-0c328c8c2e73 could not be found. {{(pid=123432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 24 10:52:55.451068 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-74f436f5-40e0-4ad9-b25b-1e38808a3bb3 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] 10.222.0.30 "GET /compute/v2.1/servers/d2c0f276-f763-4337-a5dd-0c328c8c2e73" status: 404 len: 111 microversion: 2.20 time: 0.027716 Dec 24 10:52:55.451587 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 597/1195] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Dec 24 10:52:55 2021] GET /compute/v2.1/servers/d2c0f276-f763-4337-a5dd-0c328c8c2e73 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Dec 24 10:52:56.753581 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-8494b756-c236-4ffa-9e43-c6fe4d455d26 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:52:56.754081 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-8494b756-c236-4ffa-9e43-c6fe4d455d26 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] [instance: a99a6a98-4010-4f8e-a83f-fcc490f6ece0] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:52:56.760970 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-8494b756-c236-4ffa-9e43-c6fe4d455d26 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:52:56.761471 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-8494b756-c236-4ffa-9e43-c6fe4d455d26 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:52:56.762322 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-8494b756-c236-4ffa-9e43-c6fe4d455d26 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:52:56.762754 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-8494b756-c236-4ffa-9e43-c6fe4d455d26 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:52:56.777197 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.wsgi [None req-8494b756-c236-4ffa-9e43-c6fe4d455d26 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] HTTP exception thrown: Instance a99a6a98-4010-4f8e-a83f-fcc490f6ece0 could not be found. Dec 24 10:52:56.777841 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-8494b756-c236-4ffa-9e43-c6fe4d455d26 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Returning 404 to user: Instance a99a6a98-4010-4f8e-a83f-fcc490f6ece0 could not be found. {{(pid=123431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 24 10:52:56.778673 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-8494b756-c236-4ffa-9e43-c6fe4d455d26 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] 10.222.0.30 "DELETE /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0" status: 404 len: 111 microversion: 2.20 time: 0.028864 Dec 24 10:52:56.779230 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 599/1196] 10.222.0.30 () {60 vars in 1279 bytes} [Fri Dec 24 10:52:56 2021] DELETE /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Dec 24 10:52:56.787089 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-92e0cfa0-4e56-4c44-b7da-795f53a97cd7 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:52:56.787784 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-92e0cfa0-4e56-4c44-b7da-795f53a97cd7 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] [instance: a99a6a98-4010-4f8e-a83f-fcc490f6ece0] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:52:56.800588 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-92e0cfa0-4e56-4c44-b7da-795f53a97cd7 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:52:56.800588 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-92e0cfa0-4e56-4c44-b7da-795f53a97cd7 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:52:56.800588 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-92e0cfa0-4e56-4c44-b7da-795f53a97cd7 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:52:56.800588 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-92e0cfa0-4e56-4c44-b7da-795f53a97cd7 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:52:56.810610 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.wsgi [None req-92e0cfa0-4e56-4c44-b7da-795f53a97cd7 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] HTTP exception thrown: Instance a99a6a98-4010-4f8e-a83f-fcc490f6ece0 could not be found. Dec 24 10:52:56.811194 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-92e0cfa0-4e56-4c44-b7da-795f53a97cd7 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] Returning 404 to user: Instance a99a6a98-4010-4f8e-a83f-fcc490f6ece0 could not be found. {{(pid=123432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 24 10:52:56.812019 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-92e0cfa0-4e56-4c44-b7da-795f53a97cd7 tempest-AttachVolumeShelveTestJSON-2100229812 tempest-AttachVolumeShelveTestJSON-2100229812-project] 10.222.0.30 "GET /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0" status: 404 len: 111 microversion: 2.20 time: 0.028731 Dec 24 10:52:56.812568 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 598/1197] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Dec 24 10:52:56 2021] GET /compute/v2.1/servers/a99a6a98-4010-4f8e-a83f-fcc490f6ece0 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Dec 24 10:53:03.525654 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-d5c3e29e-8b1d-40d4-88dc-248cef6b2e64 tempest-VolumesSnapshotsTestJSON-711445183 tempest-VolumesSnapshotsTestJSON-711445183-project] Action: 'create', calling method: .version_select at 0x7f1899a6a9d0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-29071976"}} {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:53:04.331971 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-d5c3e29e-8b1d-40d4-88dc-248cef6b2e64 tempest-VolumesSnapshotsTestJSON-711445183 tempest-VolumesSnapshotsTestJSON-711445183-project] 10.222.0.30 "POST /compute/v2.1/os-volumes" status: 200 len: 343 microversion: 2.1 time: 1.014506 Dec 24 10:53:04.332598 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 600/1198] 10.222.0.30 () {60 vars in 1154 bytes} [Fri Dec 24 10:53:03 2021] POST /compute/v2.1/os-volumes => generated 343 bytes in 1016 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Dec 24 10:53:04.345088 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-d0d4feef-c9e8-4260-88ca-458ef20599b6 tempest-VolumesSnapshotsTestJSON-711445183 tempest-VolumesSnapshotsTestJSON-711445183-project] Calling method '.version_select at 0x7f1899ac38b0>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:53:04.392886 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-d0d4feef-c9e8-4260-88ca-458ef20599b6 tempest-VolumesSnapshotsTestJSON-711445183 tempest-VolumesSnapshotsTestJSON-711445183-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/c6c84b83-cb02-4d8e-a70c-b13e5852bb91" status: 200 len: 343 microversion: 2.1 time: 0.051506 Dec 24 10:53:04.393453 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 599/1199] 10.222.0.30 () {58 vars in 1244 bytes} [Fri Dec 24 10:53:04 2021] GET /compute/v2.1/os-volumes/c6c84b83-cb02-4d8e-a70c-b13e5852bb91 => generated 343 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 10:53:05.405055 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-bf389ee6-7493-431a-9512-db3390aca104 tempest-VolumesSnapshotsTestJSON-711445183 tempest-VolumesSnapshotsTestJSON-711445183-project] Calling method '.version_select at 0x7f1899da0a60>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:53:05.451080 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-bf389ee6-7493-431a-9512-db3390aca104 tempest-VolumesSnapshotsTestJSON-711445183 tempest-VolumesSnapshotsTestJSON-711445183-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/c6c84b83-cb02-4d8e-a70c-b13e5852bb91" status: 200 len: 343 microversion: 2.1 time: 0.050103 Dec 24 10:53:05.451700 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 601/1200] 10.222.0.30 () {58 vars in 1244 bytes} [Fri Dec 24 10:53:05 2021] GET /compute/v2.1/os-volumes/c6c84b83-cb02-4d8e-a70c-b13e5852bb91 => generated 343 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 10:53:06.463712 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-842ab7e9-3619-458d-8bf0-0ce32c3648dd tempest-VolumesSnapshotsTestJSON-711445183 tempest-VolumesSnapshotsTestJSON-711445183-project] Calling method '.version_select at 0x7f1899a39160>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:53:06.510248 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-842ab7e9-3619-458d-8bf0-0ce32c3648dd tempest-VolumesSnapshotsTestJSON-711445183 tempest-VolumesSnapshotsTestJSON-711445183-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/c6c84b83-cb02-4d8e-a70c-b13e5852bb91" status: 200 len: 344 microversion: 2.1 time: 0.050618 Dec 24 10:53:06.510842 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 600/1201] 10.222.0.30 () {58 vars in 1244 bytes} [Fri Dec 24 10:53:06 2021] GET /compute/v2.1/os-volumes/c6c84b83-cb02-4d8e-a70c-b13e5852bb91 => generated 344 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 10:53:06.522267 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-77bfa138-598e-4a03-a4a6-a83c0a378468 tempest-VolumesSnapshotsTestJSON-711445183 tempest-VolumesSnapshotsTestJSON-711445183-project] Action: 'create', calling method: .version_select at 0x7f1899a9b550>, body: {"snapshot": {"volume_id": "c6c84b83-cb02-4d8e-a70c-b13e5852bb91", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-2084752912"}} {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:53:07.323467 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-77bfa138-598e-4a03-a4a6-a83c0a378468 tempest-VolumesSnapshotsTestJSON-711445183 tempest-VolumesSnapshotsTestJSON-711445183-project] 10.222.0.30 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.805212 Dec 24 10:53:07.324263 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 602/1202] 10.222.0.30 () {60 vars in 1161 bytes} [Fri Dec 24 10:53:06 2021] POST /compute/v2.1/os-snapshots => generated 287 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 10:53:07.333858 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-cbf461ef-5da3-4ab2-8bc5-86d36ba86491 tempest-VolumesSnapshotsTestJSON-711445183 tempest-VolumesSnapshotsTestJSON-711445183-project] Calling method '.version_select at 0x7f1899a7ca60>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:53:07.362603 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-cbf461ef-5da3-4ab2-8bc5-86d36ba86491 tempest-VolumesSnapshotsTestJSON-711445183 tempest-VolumesSnapshotsTestJSON-711445183-project] 10.222.0.30 "GET /compute/v2.1/os-snapshots/14be6f9c-ab5c-4e62-91c8-a03ae8ad5466" status: 200 len: 287 microversion: 2.1 time: 0.032397 Dec 24 10:53:07.363226 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 601/1203] 10.222.0.30 () {58 vars in 1250 bytes} [Fri Dec 24 10:53:07 2021] GET /compute/v2.1/os-snapshots/14be6f9c-ab5c-4e62-91c8-a03ae8ad5466 => generated 287 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 10:53:07.378561 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-8a844abe-5424-435b-a8c0-4c7473a6e2f6 tempest-VolumesSnapshotsTestJSON-711445183 tempest-VolumesSnapshotsTestJSON-711445183-project] Calling method '.version_select at 0x7f1899a6a430>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:53:07.406432 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-8a844abe-5424-435b-a8c0-4c7473a6e2f6 tempest-VolumesSnapshotsTestJSON-711445183 tempest-VolumesSnapshotsTestJSON-711445183-project] 10.222.0.30 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.031347 Dec 24 10:53:07.407140 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 603/1204] 10.222.0.30 () {58 vars in 1139 bytes} [Fri Dec 24 10:53:07 2021] GET /compute/v2.1/os-snapshots => generated 290 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 10:53:07.417315 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-5520d99c-4f2e-4eb3-8ce0-3b119ad4ee4f tempest-VolumesSnapshotsTestJSON-711445183 tempest-VolumesSnapshotsTestJSON-711445183-project] Calling method '.version_select at 0x7f18999c2ee0>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:53:07.445689 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-5520d99c-4f2e-4eb3-8ce0-3b119ad4ee4f tempest-VolumesSnapshotsTestJSON-711445183 tempest-VolumesSnapshotsTestJSON-711445183-project] 10.222.0.30 "GET /compute/v2.1/os-snapshots/14be6f9c-ab5c-4e62-91c8-a03ae8ad5466" status: 200 len: 287 microversion: 2.1 time: 0.031832 Dec 24 10:53:07.449473 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 602/1205] 10.222.0.30 () {58 vars in 1250 bytes} [Fri Dec 24 10:53:07 2021] GET /compute/v2.1/os-snapshots/14be6f9c-ab5c-4e62-91c8-a03ae8ad5466 => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 10:53:08.460778 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-6e865046-0580-4251-9b5f-2314a358abc8 tempest-VolumesSnapshotsTestJSON-711445183 tempest-VolumesSnapshotsTestJSON-711445183-project] Calling method '.version_select at 0x7f1899a3c940>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:53:08.489675 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-6e865046-0580-4251-9b5f-2314a358abc8 tempest-VolumesSnapshotsTestJSON-711445183 tempest-VolumesSnapshotsTestJSON-711445183-project] 10.222.0.30 "GET /compute/v2.1/os-snapshots/14be6f9c-ab5c-4e62-91c8-a03ae8ad5466" status: 200 len: 287 microversion: 2.1 time: 0.033018 Dec 24 10:53:08.490733 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 604/1206] 10.222.0.30 () {58 vars in 1250 bytes} [Fri Dec 24 10:53:08 2021] GET /compute/v2.1/os-snapshots/14be6f9c-ab5c-4e62-91c8-a03ae8ad5466 => generated 287 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 10:53:09.505177 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-d7d75efe-62ab-4c53-a145-ec77cadbf409 tempest-VolumesSnapshotsTestJSON-711445183 tempest-VolumesSnapshotsTestJSON-711445183-project] Calling method '.version_select at 0x7f1899b308b0>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:53:09.536464 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-d7d75efe-62ab-4c53-a145-ec77cadbf409 tempest-VolumesSnapshotsTestJSON-711445183 tempest-VolumesSnapshotsTestJSON-711445183-project] 10.222.0.30 "GET /compute/v2.1/os-snapshots/14be6f9c-ab5c-4e62-91c8-a03ae8ad5466" status: 200 len: 287 microversion: 2.1 time: 0.035287 Dec 24 10:53:09.537552 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 603/1207] 10.222.0.30 () {58 vars in 1250 bytes} [Fri Dec 24 10:53:09 2021] GET /compute/v2.1/os-snapshots/14be6f9c-ab5c-4e62-91c8-a03ae8ad5466 => generated 287 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 10:53:10.548797 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-cdb7b28a-7c2f-4ffe-adfe-e1d658aeb55e tempest-VolumesSnapshotsTestJSON-711445183 tempest-VolumesSnapshotsTestJSON-711445183-project] Calling method '.version_select at 0x7f1899c9ea60>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:53:10.577290 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-cdb7b28a-7c2f-4ffe-adfe-e1d658aeb55e tempest-VolumesSnapshotsTestJSON-711445183 tempest-VolumesSnapshotsTestJSON-711445183-project] 10.222.0.30 "GET /compute/v2.1/os-snapshots/14be6f9c-ab5c-4e62-91c8-a03ae8ad5466" status: 200 len: 287 microversion: 2.1 time: 0.032527 Dec 24 10:53:10.577860 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 605/1208] 10.222.0.30 () {58 vars in 1250 bytes} [Fri Dec 24 10:53:10 2021] GET /compute/v2.1/os-snapshots/14be6f9c-ab5c-4e62-91c8-a03ae8ad5466 => generated 287 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 10:53:11.589375 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-7bbab0e4-1c66-4f26-9635-987d79f2f238 tempest-VolumesSnapshotsTestJSON-711445183 tempest-VolumesSnapshotsTestJSON-711445183-project] Calling method '.version_select at 0x7f18999c2550>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:53:11.632344 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-7bbab0e4-1c66-4f26-9635-987d79f2f238 tempest-VolumesSnapshotsTestJSON-711445183 tempest-VolumesSnapshotsTestJSON-711445183-project] 10.222.0.30 "GET /compute/v2.1/os-snapshots/14be6f9c-ab5c-4e62-91c8-a03ae8ad5466" status: 200 len: 288 microversion: 2.1 time: 0.047125 Dec 24 10:53:11.632935 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 604/1209] 10.222.0.30 () {58 vars in 1250 bytes} [Fri Dec 24 10:53:11 2021] GET /compute/v2.1/os-snapshots/14be6f9c-ab5c-4e62-91c8-a03ae8ad5466 => generated 288 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 10:53:11.643591 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-5aae4839-0e18-4e49-9b99-1bc26fb78b52 tempest-VolumesSnapshotsTestJSON-711445183 tempest-VolumesSnapshotsTestJSON-711445183-project] Calling method '.version_select at 0x7f1899a409d0>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:53:11.958633 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-5aae4839-0e18-4e49-9b99-1bc26fb78b52 tempest-VolumesSnapshotsTestJSON-711445183 tempest-VolumesSnapshotsTestJSON-711445183-project] 10.222.0.30 "DELETE /compute/v2.1/os-snapshots/14be6f9c-ab5c-4e62-91c8-a03ae8ad5466" status: 202 len: 0 microversion: 2.1 time: 0.319261 Dec 24 10:53:11.959221 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 606/1210] 10.222.0.30 () {58 vars in 1253 bytes} [Fri Dec 24 10:53:11 2021] DELETE /compute/v2.1/os-snapshots/14be6f9c-ab5c-4e62-91c8-a03ae8ad5466 => generated 0 bytes in 321 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 24 10:53:11.967395 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-4a994459-aea4-4b12-b4d0-d3e68910fc26 tempest-VolumesSnapshotsTestJSON-711445183 tempest-VolumesSnapshotsTestJSON-711445183-project] Calling method '.version_select at 0x7f1899a7cb80>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:53:11.995864 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-4a994459-aea4-4b12-b4d0-d3e68910fc26 tempest-VolumesSnapshotsTestJSON-711445183 tempest-VolumesSnapshotsTestJSON-711445183-project] 10.222.0.30 "GET /compute/v2.1/os-snapshots/14be6f9c-ab5c-4e62-91c8-a03ae8ad5466" status: 200 len: 287 microversion: 2.1 time: 0.032267 Dec 24 10:53:11.996409 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 605/1211] 10.222.0.30 () {58 vars in 1250 bytes} [Fri Dec 24 10:53:11 2021] GET /compute/v2.1/os-snapshots/14be6f9c-ab5c-4e62-91c8-a03ae8ad5466 => generated 287 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 24 10:53:13.010027 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-6ff8e60b-a814-43b8-b78a-035e2a8d1b05 tempest-VolumesSnapshotsTestJSON-711445183 tempest-VolumesSnapshotsTestJSON-711445183-project] Calling method '.version_select at 0x7f1899b855e0>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:53:13.035036 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.wsgi [None req-6ff8e60b-a814-43b8-b78a-035e2a8d1b05 tempest-VolumesSnapshotsTestJSON-711445183 tempest-VolumesSnapshotsTestJSON-711445183-project] HTTP exception thrown: Snapshot 14be6f9c-ab5c-4e62-91c8-a03ae8ad5466 could not be found. Dec 24 10:53:13.051449 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-6ff8e60b-a814-43b8-b78a-035e2a8d1b05 tempest-VolumesSnapshotsTestJSON-711445183 tempest-VolumesSnapshotsTestJSON-711445183-project] Returning 404 to user: Snapshot 14be6f9c-ab5c-4e62-91c8-a03ae8ad5466 could not be found. {{(pid=123431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 24 10:53:13.051449 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-6ff8e60b-a814-43b8-b78a-035e2a8d1b05 tempest-VolumesSnapshotsTestJSON-711445183 tempest-VolumesSnapshotsTestJSON-711445183-project] 10.222.0.30 "GET /compute/v2.1/os-snapshots/14be6f9c-ab5c-4e62-91c8-a03ae8ad5466" status: 404 len: 111 microversion: 2.1 time: 0.032760 Dec 24 10:53:13.051449 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 607/1212] 10.222.0.30 () {58 vars in 1250 bytes} [Fri Dec 24 10:53:13 2021] GET /compute/v2.1/os-snapshots/14be6f9c-ab5c-4e62-91c8-a03ae8ad5466 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Dec 24 10:53:13.052009 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-0ad26621-f17b-439d-9345-d5609017473a tempest-VolumesSnapshotsTestJSON-711445183 tempest-VolumesSnapshotsTestJSON-711445183-project] Calling method '.version_select at 0x7f1899b2f940>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:53:13.467238 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-0ad26621-f17b-439d-9345-d5609017473a tempest-VolumesSnapshotsTestJSON-711445183 tempest-VolumesSnapshotsTestJSON-711445183-project] 10.222.0.30 "DELETE /compute/v2.1/os-volumes/c6c84b83-cb02-4d8e-a70c-b13e5852bb91" status: 202 len: 0 microversion: 2.1 time: 0.425129 Dec 24 10:53:13.467800 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 606/1213] 10.222.0.30 () {58 vars in 1247 bytes} [Fri Dec 24 10:53:13 2021] DELETE /compute/v2.1/os-volumes/c6c84b83-cb02-4d8e-a70c-b13e5852bb91 => generated 0 bytes in 427 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 24 10:53:13.476240 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-7757d4fa-d95b-4d6c-b445-7f56b54e0eaf tempest-VolumesSnapshotsTestJSON-711445183 tempest-VolumesSnapshotsTestJSON-711445183-project] Calling method '.version_select at 0x7f1899a9b550>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:53:13.520492 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-7757d4fa-d95b-4d6c-b445-7f56b54e0eaf tempest-VolumesSnapshotsTestJSON-711445183 tempest-VolumesSnapshotsTestJSON-711445183-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/c6c84b83-cb02-4d8e-a70c-b13e5852bb91" status: 200 len: 343 microversion: 2.1 time: 0.048367 Dec 24 10:53:13.521097 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 608/1214] 10.222.0.30 () {58 vars in 1244 bytes} [Fri Dec 24 10:53:13 2021] GET /compute/v2.1/os-volumes/c6c84b83-cb02-4d8e-a70c-b13e5852bb91 => generated 343 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 10:53:14.533113 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-2228fb97-18cd-4d4f-abb0-95fdddcc0b6a tempest-VolumesSnapshotsTestJSON-711445183 tempest-VolumesSnapshotsTestJSON-711445183-project] Calling method '.version_select at 0x7f1899a7cee0>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:53:14.576919 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-2228fb97-18cd-4d4f-abb0-95fdddcc0b6a tempest-VolumesSnapshotsTestJSON-711445183 tempest-VolumesSnapshotsTestJSON-711445183-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/c6c84b83-cb02-4d8e-a70c-b13e5852bb91" status: 200 len: 343 microversion: 2.1 time: 0.047818 Dec 24 10:53:14.577482 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 607/1215] 10.222.0.30 () {58 vars in 1244 bytes} [Fri Dec 24 10:53:14 2021] GET /compute/v2.1/os-volumes/c6c84b83-cb02-4d8e-a70c-b13e5852bb91 => generated 343 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 10:53:15.589483 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-163a0838-31c5-496c-a061-b287ea627a0b tempest-VolumesSnapshotsTestJSON-711445183 tempest-VolumesSnapshotsTestJSON-711445183-project] Calling method '.version_select at 0x7f18999c23a0>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:53:15.634436 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-163a0838-31c5-496c-a061-b287ea627a0b tempest-VolumesSnapshotsTestJSON-711445183 tempest-VolumesSnapshotsTestJSON-711445183-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/c6c84b83-cb02-4d8e-a70c-b13e5852bb91" status: 200 len: 343 microversion: 2.1 time: 0.049015 Dec 24 10:53:15.635006 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 609/1216] 10.222.0.30 () {58 vars in 1244 bytes} [Fri Dec 24 10:53:15 2021] GET /compute/v2.1/os-volumes/c6c84b83-cb02-4d8e-a70c-b13e5852bb91 => generated 343 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 10:53:16.647123 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-c29827d0-5b60-4042-8df9-e1aeea256f5f tempest-VolumesSnapshotsTestJSON-711445183 tempest-VolumesSnapshotsTestJSON-711445183-project] Calling method '.version_select at 0x7f1899b45790>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:53:16.691521 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-c29827d0-5b60-4042-8df9-e1aeea256f5f tempest-VolumesSnapshotsTestJSON-711445183 tempest-VolumesSnapshotsTestJSON-711445183-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/c6c84b83-cb02-4d8e-a70c-b13e5852bb91" status: 200 len: 343 microversion: 2.1 time: 0.048972 Dec 24 10:53:16.692081 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 608/1217] 10.222.0.30 () {58 vars in 1244 bytes} [Fri Dec 24 10:53:16 2021] GET /compute/v2.1/os-volumes/c6c84b83-cb02-4d8e-a70c-b13e5852bb91 => generated 343 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 10:53:17.704775 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-4c8749e0-57f3-4a7f-9974-efec29415980 tempest-VolumesSnapshotsTestJSON-711445183 tempest-VolumesSnapshotsTestJSON-711445183-project] Calling method '.version_select at 0x7f1899a409d0>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:53:17.731913 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.wsgi [None req-4c8749e0-57f3-4a7f-9974-efec29415980 tempest-VolumesSnapshotsTestJSON-711445183 tempest-VolumesSnapshotsTestJSON-711445183-project] HTTP exception thrown: Volume c6c84b83-cb02-4d8e-a70c-b13e5852bb91 could not be found. Dec 24 10:53:17.732526 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-4c8749e0-57f3-4a7f-9974-efec29415980 tempest-VolumesSnapshotsTestJSON-711445183 tempest-VolumesSnapshotsTestJSON-711445183-project] Returning 404 to user: Volume c6c84b83-cb02-4d8e-a70c-b13e5852bb91 could not be found. {{(pid=123431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 24 10:53:17.733608 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-4c8749e0-57f3-4a7f-9974-efec29415980 tempest-VolumesSnapshotsTestJSON-711445183 tempest-VolumesSnapshotsTestJSON-711445183-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/c6c84b83-cb02-4d8e-a70c-b13e5852bb91" status: 404 len: 109 microversion: 2.1 time: 0.033002 Dec 24 10:53:17.734164 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 610/1218] 10.222.0.30 () {58 vars in 1244 bytes} [Fri Dec 24 10:53:17 2021] GET /compute/v2.1/os-volumes/c6c84b83-cb02-4d8e-a70c-b13e5852bb91 => generated 109 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 24 10:53:17.748423 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-121ded9e-ae9f-4eda-9679-a8c23a3f89b9 tempest-VolumesSnapshotsTestJSON-711445183 tempest-VolumesSnapshotsTestJSON-711445183-project] Calling method '.version_select at 0x7f1899b45a60>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:53:17.775849 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.wsgi [None req-121ded9e-ae9f-4eda-9679-a8c23a3f89b9 tempest-VolumesSnapshotsTestJSON-711445183 tempest-VolumesSnapshotsTestJSON-711445183-project] HTTP exception thrown: Volume c6c84b83-cb02-4d8e-a70c-b13e5852bb91 could not be found. Dec 24 10:53:17.776446 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-121ded9e-ae9f-4eda-9679-a8c23a3f89b9 tempest-VolumesSnapshotsTestJSON-711445183 tempest-VolumesSnapshotsTestJSON-711445183-project] Returning 404 to user: Volume c6c84b83-cb02-4d8e-a70c-b13e5852bb91 could not be found. {{(pid=123432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 24 10:53:17.777301 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-121ded9e-ae9f-4eda-9679-a8c23a3f89b9 tempest-VolumesSnapshotsTestJSON-711445183 tempest-VolumesSnapshotsTestJSON-711445183-project] 10.222.0.30 "DELETE /compute/v2.1/os-volumes/c6c84b83-cb02-4d8e-a70c-b13e5852bb91" status: 404 len: 109 microversion: 2.1 time: 0.033475 Dec 24 10:53:17.777872 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 609/1219] 10.222.0.30 () {58 vars in 1247 bytes} [Fri Dec 24 10:53:17 2021] DELETE /compute/v2.1/os-volumes/c6c84b83-cb02-4d8e-a70c-b13e5852bb91 => generated 109 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 24 10:53:17.785609 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-8e1ad9f7-6ea6-406e-94ce-e0a778f88de6 tempest-VolumesSnapshotsTestJSON-711445183 tempest-VolumesSnapshotsTestJSON-711445183-project] Calling method '.version_select at 0x7f18999cb0d0>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:53:17.811812 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.wsgi [None req-8e1ad9f7-6ea6-406e-94ce-e0a778f88de6 tempest-VolumesSnapshotsTestJSON-711445183 tempest-VolumesSnapshotsTestJSON-711445183-project] HTTP exception thrown: Volume c6c84b83-cb02-4d8e-a70c-b13e5852bb91 could not be found. Dec 24 10:53:17.812410 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-8e1ad9f7-6ea6-406e-94ce-e0a778f88de6 tempest-VolumesSnapshotsTestJSON-711445183 tempest-VolumesSnapshotsTestJSON-711445183-project] Returning 404 to user: Volume c6c84b83-cb02-4d8e-a70c-b13e5852bb91 could not be found. {{(pid=123431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 24 10:53:17.813265 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-8e1ad9f7-6ea6-406e-94ce-e0a778f88de6 tempest-VolumesSnapshotsTestJSON-711445183 tempest-VolumesSnapshotsTestJSON-711445183-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/c6c84b83-cb02-4d8e-a70c-b13e5852bb91" status: 404 len: 109 microversion: 2.1 time: 0.031306 Dec 24 10:53:17.813803 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 611/1220] 10.222.0.30 () {58 vars in 1244 bytes} [Fri Dec 24 10:53:17 2021] GET /compute/v2.1/os-volumes/c6c84b83-cb02-4d8e-a70c-b13e5852bb91 => generated 109 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 24 10:53:30.691028 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 24 10:53:30.691801 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: Fri Dec 24 10:53:30 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 24 10:54:01.266570 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-45ed87ae-9f3a-494a-8737-440f7578c73f tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1435810126", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-2082088977", "security_groups": [{"name": "tempest-secgroup-smoke-1649720889"}], "block_device_mapping_v2": [{"uuid": "9148ad15-a070-4468-8be7-3b1422c8b76f", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "c02b29c7-4d73-429c-95e6-0bbcaa5e122f"}]}} {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:54:01.379259 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.network.neutron [None req-45ed87ae-9f3a-494a-8737-440f7578c73f tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] validate_networks() for [('c02b29c7-4d73-429c-95e6-0bbcaa5e122f', None, None, None, None, None)] {{(pid=123432) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 24 10:54:01.985577 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.virt.hardware [None req-45ed87ae-9f3a-494a-8737-440f7578c73f tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Flavor limits 0:0:0 {{(pid=123432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 24 10:54:01.986007 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.virt.hardware [None req-45ed87ae-9f3a-494a-8737-440f7578c73f tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Image limits 0:0:0 {{(pid=123432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 24 10:54:01.986541 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.virt.hardware [None req-45ed87ae-9f3a-494a-8737-440f7578c73f tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Flavor pref 0:0:0 {{(pid=123432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 24 10:54:01.986891 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.virt.hardware [None req-45ed87ae-9f3a-494a-8737-440f7578c73f tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Image pref 0:0:0 {{(pid=123432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 24 10:54:01.987303 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.virt.hardware [None req-45ed87ae-9f3a-494a-8737-440f7578c73f tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 24 10:54:02.001538 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-45ed87ae-9f3a-494a-8737-440f7578c73f tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:54:02.001981 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-45ed87ae-9f3a-494a-8737-440f7578c73f tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:54:02.014857 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-45ed87ae-9f3a-494a-8737-440f7578c73f tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:54:02.014857 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-45ed87ae-9f3a-494a-8737-440f7578c73f tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:54:02.019872 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.quota [None req-45ed87ae-9f3a-494a-8737-440f7578c73f tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Getting quotas for project 9d0fd34670674906aa9a61200251b76c. Resources: {'instances', 'cores', 'ram'} {{(pid=123432) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 24 10:54:02.023746 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.quota [None req-45ed87ae-9f3a-494a-8737-440f7578c73f tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Getting quotas for user b690a952a1704197baf5e653e27160f2 and project 9d0fd34670674906aa9a61200251b76c. Resources: {'instances', 'cores', 'ram'} {{(pid=123432) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 24 10:54:02.077910 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-45ed87ae-9f3a-494a-8737-440f7578c73f tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Going to run 1 instances... {{(pid=123432) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 24 10:54:02.080025 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-45ed87ae-9f3a-494a-8737-440f7578c73f tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] [instance: f4571cb7-621b-44dd-9b6f-5f13e4ddb918] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='9148ad15-a070-4468-8be7-3b1422c8b76f',volume_size=None,volume_type=None)] {{(pid=123432) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 24 10:54:02.737200 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-45ed87ae-9f3a-494a-8737-440f7578c73f tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.474972 Dec 24 10:54:02.738654 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 610/1221] 10.222.0.30 () {60 vars in 1146 bytes} [Fri Dec 24 10:54:01 2021] POST /compute/v2.1/servers => generated 406 bytes in 1477 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 24 10:54:02.748762 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-ce28754c-409b-4f0f-baaf-95b8e766428b tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:54:02.749401 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-ce28754c-409b-4f0f-baaf-95b8e766428b tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] [instance: f4571cb7-621b-44dd-9b6f-5f13e4ddb918] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:54:02.802436 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-ce28754c-409b-4f0f-baaf-95b8e766428b tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b690a952a1704197baf5e653e27160f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0fd34670674906aa9a61200251b76c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:54:02.809288 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-ce28754c-409b-4f0f-baaf-95b8e766428b tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] 10.222.0.30 "GET /compute/v2.1/servers/f4571cb7-621b-44dd-9b6f-5f13e4ddb918" status: 200 len: 1095 microversion: 2.1 time: 0.064810 Dec 24 10:54:02.818658 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 612/1222] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:54:02 2021] GET /compute/v2.1/servers/f4571cb7-621b-44dd-9b6f-5f13e4ddb918 => generated 1095 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:54:03.826259 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-f5e0dfc7-e305-4eb0-8d1e-4957b8db10ae tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:54:03.826873 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-f5e0dfc7-e305-4eb0-8d1e-4957b8db10ae tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] [instance: f4571cb7-621b-44dd-9b6f-5f13e4ddb918] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:54:03.877033 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-f5e0dfc7-e305-4eb0-8d1e-4957b8db10ae tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b690a952a1704197baf5e653e27160f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0fd34670674906aa9a61200251b76c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:54:03.884186 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-f5e0dfc7-e305-4eb0-8d1e-4957b8db10ae tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] 10.222.0.30 "GET /compute/v2.1/servers/f4571cb7-621b-44dd-9b6f-5f13e4ddb918" status: 200 len: 1095 microversion: 2.1 time: 0.061652 Dec 24 10:54:03.884738 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 611/1223] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:54:03 2021] GET /compute/v2.1/servers/f4571cb7-621b-44dd-9b6f-5f13e4ddb918 => generated 1095 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:54:04.901115 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-9cdf9a8e-bdc4-42cf-a461-87ace7892fea tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:54:04.901725 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-9cdf9a8e-bdc4-42cf-a461-87ace7892fea tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] [instance: f4571cb7-621b-44dd-9b6f-5f13e4ddb918] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:54:04.908025 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-9cdf9a8e-bdc4-42cf-a461-87ace7892fea tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:54:04.908470 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-9cdf9a8e-bdc4-42cf-a461-87ace7892fea tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:54:04.909292 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-9cdf9a8e-bdc4-42cf-a461-87ace7892fea tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:54:04.909762 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-9cdf9a8e-bdc4-42cf-a461-87ace7892fea tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:54:04.966985 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-9cdf9a8e-bdc4-42cf-a461-87ace7892fea tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b690a952a1704197baf5e653e27160f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0fd34670674906aa9a61200251b76c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:54:04.974913 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-9cdf9a8e-bdc4-42cf-a461-87ace7892fea tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] 10.222.0.30 "GET /compute/v2.1/servers/f4571cb7-621b-44dd-9b6f-5f13e4ddb918" status: 200 len: 1145 microversion: 2.1 time: 0.077502 Dec 24 10:54:04.975478 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 613/1224] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:54:04 2021] GET /compute/v2.1/servers/f4571cb7-621b-44dd-9b6f-5f13e4ddb918 => generated 1145 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:54:05.991751 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-952d79fd-2807-4d25-9f6f-ce54659a9fb8 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:54:05.992364 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-952d79fd-2807-4d25-9f6f-ce54659a9fb8 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] [instance: f4571cb7-621b-44dd-9b6f-5f13e4ddb918] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:54:05.999245 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-952d79fd-2807-4d25-9f6f-ce54659a9fb8 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:54:06.006210 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-952d79fd-2807-4d25-9f6f-ce54659a9fb8 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:54:06.006210 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-952d79fd-2807-4d25-9f6f-ce54659a9fb8 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:54:06.006210 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-952d79fd-2807-4d25-9f6f-ce54659a9fb8 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:54:06.058802 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-952d79fd-2807-4d25-9f6f-ce54659a9fb8 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b690a952a1704197baf5e653e27160f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0fd34670674906aa9a61200251b76c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:54:06.066015 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-952d79fd-2807-4d25-9f6f-ce54659a9fb8 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] 10.222.0.30 "GET /compute/v2.1/servers/f4571cb7-621b-44dd-9b6f-5f13e4ddb918" status: 200 len: 1145 microversion: 2.1 time: 0.078525 Dec 24 10:54:06.066571 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 612/1225] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:54:05 2021] GET /compute/v2.1/servers/f4571cb7-621b-44dd-9b6f-5f13e4ddb918 => generated 1145 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:54:07.082387 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-df58fbda-ce60-45d0-a566-d0df431d798f tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:54:07.082997 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-df58fbda-ce60-45d0-a566-d0df431d798f tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] [instance: f4571cb7-621b-44dd-9b6f-5f13e4ddb918] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:54:07.131547 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-df58fbda-ce60-45d0-a566-d0df431d798f tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:54:07.132005 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-df58fbda-ce60-45d0-a566-d0df431d798f tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:54:07.132842 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-df58fbda-ce60-45d0-a566-d0df431d798f tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:54:07.133316 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-df58fbda-ce60-45d0-a566-d0df431d798f tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:54:07.194187 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-df58fbda-ce60-45d0-a566-d0df431d798f tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b690a952a1704197baf5e653e27160f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0fd34670674906aa9a61200251b76c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:54:07.201759 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-df58fbda-ce60-45d0-a566-d0df431d798f tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] 10.222.0.30 "GET /compute/v2.1/servers/f4571cb7-621b-44dd-9b6f-5f13e4ddb918" status: 200 len: 1137 microversion: 2.1 time: 0.123111 Dec 24 10:54:07.202328 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 614/1226] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:54:07 2021] GET /compute/v2.1/servers/f4571cb7-621b-44dd-9b6f-5f13e4ddb918 => generated 1137 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:54:08.220688 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-cbfedf6c-d612-48d0-b162-d3afa9bb1646 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:54:08.221368 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-cbfedf6c-d612-48d0-b162-d3afa9bb1646 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] [instance: f4571cb7-621b-44dd-9b6f-5f13e4ddb918] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:54:08.228645 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-cbfedf6c-d612-48d0-b162-d3afa9bb1646 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:54:08.229425 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-cbfedf6c-d612-48d0-b162-d3afa9bb1646 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:54:08.230230 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-cbfedf6c-d612-48d0-b162-d3afa9bb1646 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:54:08.230663 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-cbfedf6c-d612-48d0-b162-d3afa9bb1646 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:54:08.298407 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-cbfedf6c-d612-48d0-b162-d3afa9bb1646 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b690a952a1704197baf5e653e27160f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0fd34670674906aa9a61200251b76c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:54:08.307250 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-cbfedf6c-d612-48d0-b162-d3afa9bb1646 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] 10.222.0.30 "GET /compute/v2.1/servers/f4571cb7-621b-44dd-9b6f-5f13e4ddb918" status: 200 len: 1211 microversion: 2.1 time: 0.090364 Dec 24 10:54:08.307815 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 613/1227] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:54:08 2021] GET /compute/v2.1/servers/f4571cb7-621b-44dd-9b6f-5f13e4ddb918 => generated 1211 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:54:09.324375 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-cfaa08f0-adb9-46d7-a2c4-aa98e05dd461 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:54:09.324971 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-cfaa08f0-adb9-46d7-a2c4-aa98e05dd461 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] [instance: f4571cb7-621b-44dd-9b6f-5f13e4ddb918] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:54:09.331260 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-cfaa08f0-adb9-46d7-a2c4-aa98e05dd461 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:54:09.332211 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-cfaa08f0-adb9-46d7-a2c4-aa98e05dd461 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:54:09.333024 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-cfaa08f0-adb9-46d7-a2c4-aa98e05dd461 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:54:09.333462 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-cfaa08f0-adb9-46d7-a2c4-aa98e05dd461 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:54:09.468026 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-cfaa08f0-adb9-46d7-a2c4-aa98e05dd461 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b690a952a1704197baf5e653e27160f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0fd34670674906aa9a61200251b76c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:54:09.495415 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-cfaa08f0-adb9-46d7-a2c4-aa98e05dd461 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] 10.222.0.30 "GET /compute/v2.1/servers/f4571cb7-621b-44dd-9b6f-5f13e4ddb918" status: 200 len: 1279 microversion: 2.1 time: 0.174550 Dec 24 10:54:09.501058 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 615/1228] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:54:09 2021] GET /compute/v2.1/servers/f4571cb7-621b-44dd-9b6f-5f13e4ddb918 => generated 1279 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:54:09.817154 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [req-d0e782fa-cd88-42d8-8e34-635568f96eba req-b4150af8-d082-4621-8f96-bf5bb0082193 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f4571cb7-621b-44dd-9b6f-5f13e4ddb918", "tag": "64a9ec23-cf36-4986-aad5-30b008dd3191"}]} {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:54:09.820471 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 10:54:09.820471 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: warnings.warn(msg) Dec 24 10:54:09.832416 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [req-d0e782fa-cd88-42d8-8e34-635568f96eba req-b4150af8-d082-4621-8f96-bf5bb0082193 service nova] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:54:09.832874 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [req-d0e782fa-cd88-42d8-8e34-635568f96eba req-b4150af8-d082-4621-8f96-bf5bb0082193 service nova] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:54:09.845581 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.compute.server_external_events [req-d0e782fa-cd88-42d8-8e34-635568f96eba req-b4150af8-d082-4621-8f96-bf5bb0082193 service nova] Creating event network-changed:64a9ec23-cf36-4986-aad5-30b008dd3191 for instance f4571cb7-621b-44dd-9b6f-5f13e4ddb918 on hv-cinder-81644 Dec 24 10:54:09.850762 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [req-d0e782fa-cd88-42d8-8e34-635568f96eba req-b4150af8-d082-4621-8f96-bf5bb0082193 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039564 Dec 24 10:54:09.851482 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 614/1229] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Dec 24 10:54:09 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 10:54:10.517157 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-47fb11f1-8389-43ab-ae22-8267aa6596a4 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:54:10.517842 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-47fb11f1-8389-43ab-ae22-8267aa6596a4 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] [instance: f4571cb7-621b-44dd-9b6f-5f13e4ddb918] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:54:10.527143 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-47fb11f1-8389-43ab-ae22-8267aa6596a4 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:54:10.527844 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-47fb11f1-8389-43ab-ae22-8267aa6596a4 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:54:10.529181 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-47fb11f1-8389-43ab-ae22-8267aa6596a4 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:54:10.529765 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-47fb11f1-8389-43ab-ae22-8267aa6596a4 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:54:10.681501 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-47fb11f1-8389-43ab-ae22-8267aa6596a4 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b690a952a1704197baf5e653e27160f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0fd34670674906aa9a61200251b76c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:54:10.688944 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-47fb11f1-8389-43ab-ae22-8267aa6596a4 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] 10.222.0.30 "GET /compute/v2.1/servers/f4571cb7-621b-44dd-9b6f-5f13e4ddb918" status: 200 len: 1267 microversion: 2.1 time: 0.175532 Dec 24 10:54:10.689511 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 616/1230] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:54:10 2021] GET /compute/v2.1/servers/f4571cb7-621b-44dd-9b6f-5f13e4ddb918 => generated 1267 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:54:11.706815 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-24e96fe7-c139-4040-8d5f-a279ed331770 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:54:11.707601 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-24e96fe7-c139-4040-8d5f-a279ed331770 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] [instance: f4571cb7-621b-44dd-9b6f-5f13e4ddb918] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:54:11.714118 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-24e96fe7-c139-4040-8d5f-a279ed331770 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:54:11.714557 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-24e96fe7-c139-4040-8d5f-a279ed331770 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:54:11.715336 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-24e96fe7-c139-4040-8d5f-a279ed331770 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:54:11.715806 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-24e96fe7-c139-4040-8d5f-a279ed331770 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:54:11.846363 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-24e96fe7-c139-4040-8d5f-a279ed331770 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b690a952a1704197baf5e653e27160f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0fd34670674906aa9a61200251b76c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:54:11.853772 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-24e96fe7-c139-4040-8d5f-a279ed331770 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] 10.222.0.30 "GET /compute/v2.1/servers/f4571cb7-621b-44dd-9b6f-5f13e4ddb918" status: 200 len: 1267 microversion: 2.1 time: 0.151521 Dec 24 10:54:11.854278 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 615/1231] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:54:11 2021] GET /compute/v2.1/servers/f4571cb7-621b-44dd-9b6f-5f13e4ddb918 => generated 1267 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 24 10:54:12.870233 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-ca554959-8f2e-4204-bbfe-e57421040d20 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:54:12.870960 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-ca554959-8f2e-4204-bbfe-e57421040d20 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] [instance: f4571cb7-621b-44dd-9b6f-5f13e4ddb918] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:54:12.877439 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-ca554959-8f2e-4204-bbfe-e57421040d20 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:54:12.877872 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-ca554959-8f2e-4204-bbfe-e57421040d20 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:54:12.879155 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-ca554959-8f2e-4204-bbfe-e57421040d20 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:54:12.879587 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-ca554959-8f2e-4204-bbfe-e57421040d20 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:54:13.011179 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-ca554959-8f2e-4204-bbfe-e57421040d20 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b690a952a1704197baf5e653e27160f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0fd34670674906aa9a61200251b76c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:54:13.018957 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-ca554959-8f2e-4204-bbfe-e57421040d20 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] 10.222.0.30 "GET /compute/v2.1/servers/f4571cb7-621b-44dd-9b6f-5f13e4ddb918" status: 200 len: 1267 microversion: 2.1 time: 0.152420 Dec 24 10:54:13.019529 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 617/1232] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:54:12 2021] GET /compute/v2.1/servers/f4571cb7-621b-44dd-9b6f-5f13e4ddb918 => generated 1267 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:54:14.035111 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-66f5934b-0167-45d9-9a5f-cc8501b8be95 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:54:14.035733 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-66f5934b-0167-45d9-9a5f-cc8501b8be95 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] [instance: f4571cb7-621b-44dd-9b6f-5f13e4ddb918] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:54:14.042059 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-66f5934b-0167-45d9-9a5f-cc8501b8be95 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:54:14.042510 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-66f5934b-0167-45d9-9a5f-cc8501b8be95 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:54:14.043301 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-66f5934b-0167-45d9-9a5f-cc8501b8be95 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:54:14.043739 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-66f5934b-0167-45d9-9a5f-cc8501b8be95 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:54:14.177737 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-66f5934b-0167-45d9-9a5f-cc8501b8be95 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b690a952a1704197baf5e653e27160f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0fd34670674906aa9a61200251b76c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:54:14.185218 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-66f5934b-0167-45d9-9a5f-cc8501b8be95 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] 10.222.0.30 "GET /compute/v2.1/servers/f4571cb7-621b-44dd-9b6f-5f13e4ddb918" status: 200 len: 1267 microversion: 2.1 time: 0.153669 Dec 24 10:54:14.185797 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 616/1233] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:54:14 2021] GET /compute/v2.1/servers/f4571cb7-621b-44dd-9b6f-5f13e4ddb918 => generated 1267 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:54:15.202535 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-39a950e8-49fd-4603-8496-7dc2f9de883b tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:54:15.203142 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-39a950e8-49fd-4603-8496-7dc2f9de883b tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] [instance: f4571cb7-621b-44dd-9b6f-5f13e4ddb918] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:54:15.209563 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-39a950e8-49fd-4603-8496-7dc2f9de883b tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:54:15.210012 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-39a950e8-49fd-4603-8496-7dc2f9de883b tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:54:15.210826 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-39a950e8-49fd-4603-8496-7dc2f9de883b tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:54:15.211306 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-39a950e8-49fd-4603-8496-7dc2f9de883b tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:54:15.342974 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-39a950e8-49fd-4603-8496-7dc2f9de883b tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b690a952a1704197baf5e653e27160f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0fd34670674906aa9a61200251b76c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:54:15.350431 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-39a950e8-49fd-4603-8496-7dc2f9de883b tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] 10.222.0.30 "GET /compute/v2.1/servers/f4571cb7-621b-44dd-9b6f-5f13e4ddb918" status: 200 len: 1267 microversion: 2.1 time: 0.151636 Dec 24 10:54:15.351008 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 618/1234] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:54:15 2021] GET /compute/v2.1/servers/f4571cb7-621b-44dd-9b6f-5f13e4ddb918 => generated 1267 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:54:16.367818 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-2cfe3ff0-81d0-4757-a25f-c86d59da9488 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:54:16.368418 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-2cfe3ff0-81d0-4757-a25f-c86d59da9488 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] [instance: f4571cb7-621b-44dd-9b6f-5f13e4ddb918] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:54:16.374801 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-2cfe3ff0-81d0-4757-a25f-c86d59da9488 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:54:16.375261 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-2cfe3ff0-81d0-4757-a25f-c86d59da9488 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:54:16.376034 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-2cfe3ff0-81d0-4757-a25f-c86d59da9488 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:54:16.376461 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-2cfe3ff0-81d0-4757-a25f-c86d59da9488 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:54:16.506004 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-2cfe3ff0-81d0-4757-a25f-c86d59da9488 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b690a952a1704197baf5e653e27160f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0fd34670674906aa9a61200251b76c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:54:16.513609 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-2cfe3ff0-81d0-4757-a25f-c86d59da9488 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] 10.222.0.30 "GET /compute/v2.1/servers/f4571cb7-621b-44dd-9b6f-5f13e4ddb918" status: 200 len: 1267 microversion: 2.1 time: 0.149426 Dec 24 10:54:16.518235 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 617/1235] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:54:16 2021] GET /compute/v2.1/servers/f4571cb7-621b-44dd-9b6f-5f13e4ddb918 => generated 1267 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:54:17.533237 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-aa39d5c4-d8a8-4a37-9556-67ad514292f3 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:54:17.533820 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-aa39d5c4-d8a8-4a37-9556-67ad514292f3 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] [instance: f4571cb7-621b-44dd-9b6f-5f13e4ddb918] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:54:17.542088 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-aa39d5c4-d8a8-4a37-9556-67ad514292f3 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:54:17.542664 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-aa39d5c4-d8a8-4a37-9556-67ad514292f3 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:54:17.543318 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-aa39d5c4-d8a8-4a37-9556-67ad514292f3 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:54:17.543748 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-aa39d5c4-d8a8-4a37-9556-67ad514292f3 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:54:17.676179 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-aa39d5c4-d8a8-4a37-9556-67ad514292f3 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b690a952a1704197baf5e653e27160f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0fd34670674906aa9a61200251b76c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:54:17.683478 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-aa39d5c4-d8a8-4a37-9556-67ad514292f3 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] 10.222.0.30 "GET /compute/v2.1/servers/f4571cb7-621b-44dd-9b6f-5f13e4ddb918" status: 200 len: 1267 microversion: 2.1 time: 0.155713 Dec 24 10:54:17.684046 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 619/1236] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:54:17 2021] GET /compute/v2.1/servers/f4571cb7-621b-44dd-9b6f-5f13e4ddb918 => generated 1267 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:54:18.700403 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-f3303727-dcc7-4d81-8469-262f0a7e8bb8 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:54:18.701163 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-f3303727-dcc7-4d81-8469-262f0a7e8bb8 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] [instance: f4571cb7-621b-44dd-9b6f-5f13e4ddb918] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:54:18.708481 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-f3303727-dcc7-4d81-8469-262f0a7e8bb8 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:54:18.713957 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-f3303727-dcc7-4d81-8469-262f0a7e8bb8 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:54:18.713957 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-f3303727-dcc7-4d81-8469-262f0a7e8bb8 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:54:18.713957 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-f3303727-dcc7-4d81-8469-262f0a7e8bb8 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:54:18.849233 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-f3303727-dcc7-4d81-8469-262f0a7e8bb8 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b690a952a1704197baf5e653e27160f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0fd34670674906aa9a61200251b76c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:54:18.856936 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-f3303727-dcc7-4d81-8469-262f0a7e8bb8 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] 10.222.0.30 "GET /compute/v2.1/servers/f4571cb7-621b-44dd-9b6f-5f13e4ddb918" status: 200 len: 1267 microversion: 2.1 time: 0.160045 Dec 24 10:54:18.857539 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 618/1237] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:54:18 2021] GET /compute/v2.1/servers/f4571cb7-621b-44dd-9b6f-5f13e4ddb918 => generated 1267 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:54:19.874699 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-c6d24519-29be-42c3-8f31-84319bf2eddf tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:54:19.875311 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-c6d24519-29be-42c3-8f31-84319bf2eddf tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] [instance: f4571cb7-621b-44dd-9b6f-5f13e4ddb918] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:54:19.882134 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-c6d24519-29be-42c3-8f31-84319bf2eddf tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:54:19.882579 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-c6d24519-29be-42c3-8f31-84319bf2eddf tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:54:19.883349 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-c6d24519-29be-42c3-8f31-84319bf2eddf tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:54:19.883779 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-c6d24519-29be-42c3-8f31-84319bf2eddf tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:54:20.017145 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-c6d24519-29be-42c3-8f31-84319bf2eddf tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b690a952a1704197baf5e653e27160f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0fd34670674906aa9a61200251b76c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:54:20.024440 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-c6d24519-29be-42c3-8f31-84319bf2eddf tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] 10.222.0.30 "GET /compute/v2.1/servers/f4571cb7-621b-44dd-9b6f-5f13e4ddb918" status: 200 len: 1267 microversion: 2.1 time: 0.153413 Dec 24 10:54:20.025043 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 620/1238] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:54:19 2021] GET /compute/v2.1/servers/f4571cb7-621b-44dd-9b6f-5f13e4ddb918 => generated 1267 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:54:21.040209 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-aef2f651-b32a-4308-9835-49718d9ffee2 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:54:21.040838 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-aef2f651-b32a-4308-9835-49718d9ffee2 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] [instance: f4571cb7-621b-44dd-9b6f-5f13e4ddb918] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:54:21.046140 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [req-47ba8a54-e64e-43b5-829b-58caae00d6b7 req-0f835b64-67bb-49b8-a0d4-d16486c5f46b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4571cb7-621b-44dd-9b6f-5f13e4ddb918", "name": "network-vif-plugged", "status": "completed", "tag": "64a9ec23-cf36-4986-aad5-30b008dd3191"}]} {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:54:21.047613 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-aef2f651-b32a-4308-9835-49718d9ffee2 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:54:21.048188 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-aef2f651-b32a-4308-9835-49718d9ffee2 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:54:21.048452 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 10:54:21.048452 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: warnings.warn(msg) Dec 24 10:54:21.049009 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-aef2f651-b32a-4308-9835-49718d9ffee2 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:54:21.049456 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-aef2f651-b32a-4308-9835-49718d9ffee2 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:54:21.056028 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [req-47ba8a54-e64e-43b5-829b-58caae00d6b7 req-0f835b64-67bb-49b8-a0d4-d16486c5f46b service nova] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:54:21.056471 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [req-47ba8a54-e64e-43b5-829b-58caae00d6b7 req-0f835b64-67bb-49b8-a0d4-d16486c5f46b service nova] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:54:21.068866 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.compute.server_external_events [req-47ba8a54-e64e-43b5-829b-58caae00d6b7 req-0f835b64-67bb-49b8-a0d4-d16486c5f46b service nova] Creating event network-vif-plugged:64a9ec23-cf36-4986-aad5-30b008dd3191 for instance f4571cb7-621b-44dd-9b6f-5f13e4ddb918 on hv-cinder-81644 Dec 24 10:54:21.074468 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [req-47ba8a54-e64e-43b5-829b-58caae00d6b7 req-0f835b64-67bb-49b8-a0d4-d16486c5f46b service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032016 Dec 24 10:54:21.075402 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 621/1239] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Dec 24 10:54:21 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 10:54:21.191024 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-aef2f651-b32a-4308-9835-49718d9ffee2 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b690a952a1704197baf5e653e27160f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0fd34670674906aa9a61200251b76c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:54:21.199110 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-aef2f651-b32a-4308-9835-49718d9ffee2 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] 10.222.0.30 "GET /compute/v2.1/servers/f4571cb7-621b-44dd-9b6f-5f13e4ddb918" status: 200 len: 1267 microversion: 2.1 time: 0.162553 Dec 24 10:54:21.199689 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 619/1240] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:54:21 2021] GET /compute/v2.1/servers/f4571cb7-621b-44dd-9b6f-5f13e4ddb918 => generated 1267 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:54:22.215660 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-c909cb63-49b1-4528-86ec-7c757f8981ff tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:54:22.216350 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-c909cb63-49b1-4528-86ec-7c757f8981ff tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] [instance: f4571cb7-621b-44dd-9b6f-5f13e4ddb918] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:54:22.223501 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-c909cb63-49b1-4528-86ec-7c757f8981ff tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:54:22.223938 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-c909cb63-49b1-4528-86ec-7c757f8981ff tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:54:22.224704 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-c909cb63-49b1-4528-86ec-7c757f8981ff tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:54:22.225161 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-c909cb63-49b1-4528-86ec-7c757f8981ff tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:54:22.361111 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-c909cb63-49b1-4528-86ec-7c757f8981ff tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b690a952a1704197baf5e653e27160f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0fd34670674906aa9a61200251b76c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:54:22.365274 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-c909cb63-49b1-4528-86ec-7c757f8981ff tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] 10.222.0.30 "GET /compute/v2.1/servers/f4571cb7-621b-44dd-9b6f-5f13e4ddb918" status: 200 len: 1267 microversion: 2.1 time: 0.153573 Dec 24 10:54:22.365845 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 622/1241] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:54:22 2021] GET /compute/v2.1/servers/f4571cb7-621b-44dd-9b6f-5f13e4ddb918 => generated 1267 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:54:23.381608 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-7195cac4-0dd2-4986-a4ff-1b8d9707e47f tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:54:23.382132 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-7195cac4-0dd2-4986-a4ff-1b8d9707e47f tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] [instance: f4571cb7-621b-44dd-9b6f-5f13e4ddb918] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:54:23.388588 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-7195cac4-0dd2-4986-a4ff-1b8d9707e47f tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:54:23.389064 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-7195cac4-0dd2-4986-a4ff-1b8d9707e47f tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:54:23.389832 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-7195cac4-0dd2-4986-a4ff-1b8d9707e47f tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:54:23.390257 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-7195cac4-0dd2-4986-a4ff-1b8d9707e47f tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:54:23.515820 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-7195cac4-0dd2-4986-a4ff-1b8d9707e47f tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b690a952a1704197baf5e653e27160f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0fd34670674906aa9a61200251b76c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:54:23.523538 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-7195cac4-0dd2-4986-a4ff-1b8d9707e47f tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] 10.222.0.30 "GET /compute/v2.1/servers/f4571cb7-621b-44dd-9b6f-5f13e4ddb918" status: 200 len: 1453 microversion: 2.1 time: 0.145613 Dec 24 10:54:23.524090 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 620/1242] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:54:23 2021] GET /compute/v2.1/servers/f4571cb7-621b-44dd-9b6f-5f13e4ddb918 => generated 1453 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:54:23.539588 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-b3e397be-788e-4d38-998e-c43c4a88c89f tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:54:23.540204 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-b3e397be-788e-4d38-998e-c43c4a88c89f tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] [instance: f4571cb7-621b-44dd-9b6f-5f13e4ddb918] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:54:23.546369 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-b3e397be-788e-4d38-998e-c43c4a88c89f tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:54:23.546810 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-b3e397be-788e-4d38-998e-c43c4a88c89f tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:54:23.547580 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-b3e397be-788e-4d38-998e-c43c4a88c89f tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:54:23.548009 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-b3e397be-788e-4d38-998e-c43c4a88c89f tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:54:23.680226 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-b3e397be-788e-4d38-998e-c43c4a88c89f tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b690a952a1704197baf5e653e27160f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0fd34670674906aa9a61200251b76c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:54:23.687556 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-b3e397be-788e-4d38-998e-c43c4a88c89f tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] 10.222.0.30 "GET /compute/v2.1/servers/f4571cb7-621b-44dd-9b6f-5f13e4ddb918" status: 200 len: 1453 microversion: 2.1 time: 0.151561 Dec 24 10:54:23.688131 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 623/1243] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:54:23 2021] GET /compute/v2.1/servers/f4571cb7-621b-44dd-9b6f-5f13e4ddb918 => generated 1453 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:54:26.234067 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [req-3bb60568-6151-4ade-9083-7b63f2041491 req-e632305d-c071-40d5-97e5-45bfb18e13e8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f4571cb7-621b-44dd-9b6f-5f13e4ddb918", "tag": "64a9ec23-cf36-4986-aad5-30b008dd3191"}]} {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:54:26.235578 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 10:54:26.235578 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: warnings.warn(msg) Dec 24 10:54:26.243484 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [req-3bb60568-6151-4ade-9083-7b63f2041491 req-e632305d-c071-40d5-97e5-45bfb18e13e8 service nova] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:54:26.243925 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [req-3bb60568-6151-4ade-9083-7b63f2041491 req-e632305d-c071-40d5-97e5-45bfb18e13e8 service nova] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:54:26.255291 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.compute.server_external_events [req-3bb60568-6151-4ade-9083-7b63f2041491 req-e632305d-c071-40d5-97e5-45bfb18e13e8 service nova] Creating event network-changed:64a9ec23-cf36-4986-aad5-30b008dd3191 for instance f4571cb7-621b-44dd-9b6f-5f13e4ddb918 on hv-cinder-81644 Dec 24 10:54:26.260460 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [req-3bb60568-6151-4ade-9083-7b63f2041491 req-e632305d-c071-40d5-97e5-45bfb18e13e8 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030045 Dec 24 10:54:26.261445 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 621/1244] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Dec 24 10:54:26 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 10:54:52.367598 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-625c22af-090f-4958-a9c8-e67721fa3267 tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:54:52.368187 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-625c22af-090f-4958-a9c8-e67721fa3267 tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] [instance: ffb09c23-c1d1-4e71-9510-70dd7a07cc40] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:54:52.374054 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-625c22af-090f-4958-a9c8-e67721fa3267 tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:54:52.374493 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-625c22af-090f-4958-a9c8-e67721fa3267 tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:54:52.375259 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-625c22af-090f-4958-a9c8-e67721fa3267 tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:54:52.375706 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-625c22af-090f-4958-a9c8-e67721fa3267 tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:54:52.398066 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.objects.instance [None req-625c22af-090f-4958-a9c8-e67721fa3267 tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Lazy-loading 'flavor' on Instance uuid ffb09c23-c1d1-4e71-9510-70dd7a07cc40 {{(pid=123431) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 24 10:54:52.664425 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-625c22af-090f-4958-a9c8-e67721fa3267 tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] 10.222.0.30 "POST /compute/v2.1/servers/ffb09c23-c1d1-4e71-9510-70dd7a07cc40/action" status: 202 len: 0 microversion: 2.1 time: 0.300485 Dec 24 10:54:52.665549 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 624/1245] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Dec 24 10:54:52 2021] POST /compute/v2.1/servers/ffb09c23-c1d1-4e71-9510-70dd7a07cc40/action => generated 0 bytes in 302 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 24 10:54:52.674702 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-0f26086a-9b80-461c-994d-c1d26aa3477f tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:54:52.675396 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-0f26086a-9b80-461c-994d-c1d26aa3477f tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] [instance: ffb09c23-c1d1-4e71-9510-70dd7a07cc40] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:54:52.681412 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-0f26086a-9b80-461c-994d-c1d26aa3477f tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:54:52.681840 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-0f26086a-9b80-461c-994d-c1d26aa3477f tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:54:52.682615 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-0f26086a-9b80-461c-994d-c1d26aa3477f tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:54:52.683042 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-0f26086a-9b80-461c-994d-c1d26aa3477f tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:54:52.817048 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-0f26086a-9b80-461c-994d-c1d26aa3477f tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366d62f6b3f4a0487d37e765a3fad02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abda8fd8574437e892913c775910de0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:54:52.824612 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-0f26086a-9b80-461c-994d-c1d26aa3477f tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] 10.222.0.30 "GET /compute/v2.1/servers/ffb09c23-c1d1-4e71-9510-70dd7a07cc40" status: 200 len: 1566 microversion: 2.1 time: 0.154888 Dec 24 10:54:52.825194 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 622/1246] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:54:52 2021] GET /compute/v2.1/servers/ffb09c23-c1d1-4e71-9510-70dd7a07cc40 => generated 1566 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:54:53.843224 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-d5518625-d2a0-4a31-b3d5-31ef279bf7cf tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:54:53.843916 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-d5518625-d2a0-4a31-b3d5-31ef279bf7cf tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] [instance: ffb09c23-c1d1-4e71-9510-70dd7a07cc40] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:54:53.852543 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-d5518625-d2a0-4a31-b3d5-31ef279bf7cf tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:54:53.853014 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-d5518625-d2a0-4a31-b3d5-31ef279bf7cf tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:54:53.853781 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-d5518625-d2a0-4a31-b3d5-31ef279bf7cf tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:54:53.854238 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-d5518625-d2a0-4a31-b3d5-31ef279bf7cf tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:54:53.990065 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-d5518625-d2a0-4a31-b3d5-31ef279bf7cf tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366d62f6b3f4a0487d37e765a3fad02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abda8fd8574437e892913c775910de0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:54:53.999005 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-d5518625-d2a0-4a31-b3d5-31ef279bf7cf tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] 10.222.0.30 "GET /compute/v2.1/servers/ffb09c23-c1d1-4e71-9510-70dd7a07cc40" status: 200 len: 1566 microversion: 2.1 time: 0.160387 Dec 24 10:54:53.999579 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 625/1247] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:54:53 2021] GET /compute/v2.1/servers/ffb09c23-c1d1-4e71-9510-70dd7a07cc40 => generated 1566 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:54:55.016832 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-3a6297df-5f1f-4cf5-b00e-20f4d05346d0 tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:54:55.017449 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-3a6297df-5f1f-4cf5-b00e-20f4d05346d0 tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] [instance: ffb09c23-c1d1-4e71-9510-70dd7a07cc40] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:54:55.023674 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-3a6297df-5f1f-4cf5-b00e-20f4d05346d0 tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:54:55.024126 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-3a6297df-5f1f-4cf5-b00e-20f4d05346d0 tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:54:55.024938 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-3a6297df-5f1f-4cf5-b00e-20f4d05346d0 tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:54:55.025377 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-3a6297df-5f1f-4cf5-b00e-20f4d05346d0 tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:54:55.153021 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-3a6297df-5f1f-4cf5-b00e-20f4d05346d0 tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366d62f6b3f4a0487d37e765a3fad02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abda8fd8574437e892913c775910de0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:54:55.160397 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-3a6297df-5f1f-4cf5-b00e-20f4d05346d0 tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] 10.222.0.30 "GET /compute/v2.1/servers/ffb09c23-c1d1-4e71-9510-70dd7a07cc40" status: 200 len: 1566 microversion: 2.1 time: 0.147251 Dec 24 10:54:55.160991 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 623/1248] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:54:55 2021] GET /compute/v2.1/servers/ffb09c23-c1d1-4e71-9510-70dd7a07cc40 => generated 1566 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:54:56.176646 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-42c6b36e-5012-4f41-a245-d806cf9958ae tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:54:56.177286 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-42c6b36e-5012-4f41-a245-d806cf9958ae tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] [instance: ffb09c23-c1d1-4e71-9510-70dd7a07cc40] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:54:56.183540 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-42c6b36e-5012-4f41-a245-d806cf9958ae tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:54:56.183982 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-42c6b36e-5012-4f41-a245-d806cf9958ae tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:54:56.184752 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-42c6b36e-5012-4f41-a245-d806cf9958ae tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:54:56.185209 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-42c6b36e-5012-4f41-a245-d806cf9958ae tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:54:56.315378 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-42c6b36e-5012-4f41-a245-d806cf9958ae tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366d62f6b3f4a0487d37e765a3fad02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abda8fd8574437e892913c775910de0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:54:56.322593 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-42c6b36e-5012-4f41-a245-d806cf9958ae tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] 10.222.0.30 "GET /compute/v2.1/servers/ffb09c23-c1d1-4e71-9510-70dd7a07cc40" status: 200 len: 1566 microversion: 2.1 time: 0.149688 Dec 24 10:54:56.323151 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 626/1249] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:54:56 2021] GET /compute/v2.1/servers/ffb09c23-c1d1-4e71-9510-70dd7a07cc40 => generated 1566 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:54:57.339979 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-42b0e988-4717-45a1-ad14-6548684b61e9 tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:54:57.341283 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-42b0e988-4717-45a1-ad14-6548684b61e9 tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] [instance: ffb09c23-c1d1-4e71-9510-70dd7a07cc40] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:54:57.348632 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-42b0e988-4717-45a1-ad14-6548684b61e9 tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:54:57.349225 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-42b0e988-4717-45a1-ad14-6548684b61e9 tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:54:57.350001 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-42b0e988-4717-45a1-ad14-6548684b61e9 tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:54:57.350427 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-42b0e988-4717-45a1-ad14-6548684b61e9 tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:54:57.520182 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-42b0e988-4717-45a1-ad14-6548684b61e9 tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366d62f6b3f4a0487d37e765a3fad02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abda8fd8574437e892913c775910de0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:54:57.527539 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-42b0e988-4717-45a1-ad14-6548684b61e9 tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] 10.222.0.30 "GET /compute/v2.1/servers/ffb09c23-c1d1-4e71-9510-70dd7a07cc40" status: 200 len: 1566 microversion: 2.1 time: 0.191145 Dec 24 10:54:57.528096 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 624/1250] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:54:57 2021] GET /compute/v2.1/servers/ffb09c23-c1d1-4e71-9510-70dd7a07cc40 => generated 1566 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:54:58.543724 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-bc5764e9-be24-4ea0-bfd9-2cfb6094c927 tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:54:58.544331 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-bc5764e9-be24-4ea0-bfd9-2cfb6094c927 tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] [instance: ffb09c23-c1d1-4e71-9510-70dd7a07cc40] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:54:58.551219 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-bc5764e9-be24-4ea0-bfd9-2cfb6094c927 tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:54:58.551660 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-bc5764e9-be24-4ea0-bfd9-2cfb6094c927 tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:54:58.552431 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-bc5764e9-be24-4ea0-bfd9-2cfb6094c927 tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:54:58.552891 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-bc5764e9-be24-4ea0-bfd9-2cfb6094c927 tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:54:58.680049 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-bc5764e9-be24-4ea0-bfd9-2cfb6094c927 tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366d62f6b3f4a0487d37e765a3fad02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abda8fd8574437e892913c775910de0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:54:58.687430 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-bc5764e9-be24-4ea0-bfd9-2cfb6094c927 tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] 10.222.0.30 "GET /compute/v2.1/servers/ffb09c23-c1d1-4e71-9510-70dd7a07cc40" status: 200 len: 1566 microversion: 2.1 time: 0.147501 Dec 24 10:54:58.688006 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 627/1251] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:54:58 2021] GET /compute/v2.1/servers/ffb09c23-c1d1-4e71-9510-70dd7a07cc40 => generated 1566 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:54:59.703935 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-2615f28c-22b8-4da3-8116-f721f94ab64c tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:54:59.704536 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-2615f28c-22b8-4da3-8116-f721f94ab64c tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] [instance: ffb09c23-c1d1-4e71-9510-70dd7a07cc40] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:54:59.710727 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-2615f28c-22b8-4da3-8116-f721f94ab64c tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:54:59.711169 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-2615f28c-22b8-4da3-8116-f721f94ab64c tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:54:59.711932 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-2615f28c-22b8-4da3-8116-f721f94ab64c tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:54:59.712362 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-2615f28c-22b8-4da3-8116-f721f94ab64c tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:54:59.841634 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-2615f28c-22b8-4da3-8116-f721f94ab64c tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366d62f6b3f4a0487d37e765a3fad02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abda8fd8574437e892913c775910de0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:54:59.848094 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-2615f28c-22b8-4da3-8116-f721f94ab64c tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] 10.222.0.30 "GET /compute/v2.1/servers/ffb09c23-c1d1-4e71-9510-70dd7a07cc40" status: 200 len: 1566 microversion: 2.1 time: 0.147823 Dec 24 10:54:59.848660 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 625/1252] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:54:59 2021] GET /compute/v2.1/servers/ffb09c23-c1d1-4e71-9510-70dd7a07cc40 => generated 1566 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:55:00.865762 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-41c4059e-c9f2-4ba8-919e-56f532062d42 tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:55:00.866525 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-41c4059e-c9f2-4ba8-919e-56f532062d42 tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] [instance: ffb09c23-c1d1-4e71-9510-70dd7a07cc40] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:55:00.873495 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-41c4059e-c9f2-4ba8-919e-56f532062d42 tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:55:00.873946 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-41c4059e-c9f2-4ba8-919e-56f532062d42 tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:55:00.874718 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-41c4059e-c9f2-4ba8-919e-56f532062d42 tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:55:00.875146 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-41c4059e-c9f2-4ba8-919e-56f532062d42 tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:55:01.027502 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-41c4059e-c9f2-4ba8-919e-56f532062d42 tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366d62f6b3f4a0487d37e765a3fad02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abda8fd8574437e892913c775910de0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:55:01.035297 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-41c4059e-c9f2-4ba8-919e-56f532062d42 tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] 10.222.0.30 "GET /compute/v2.1/servers/ffb09c23-c1d1-4e71-9510-70dd7a07cc40" status: 200 len: 1566 microversion: 2.1 time: 0.173277 Dec 24 10:55:01.035870 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 628/1253] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:55:00 2021] GET /compute/v2.1/servers/ffb09c23-c1d1-4e71-9510-70dd7a07cc40 => generated 1566 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:55:02.052021 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-9201342e-5189-4fa4-af34-f288e2c267c0 tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:55:02.052643 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-9201342e-5189-4fa4-af34-f288e2c267c0 tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] [instance: ffb09c23-c1d1-4e71-9510-70dd7a07cc40] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:55:02.059238 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-9201342e-5189-4fa4-af34-f288e2c267c0 tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:55:02.059691 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-9201342e-5189-4fa4-af34-f288e2c267c0 tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:55:02.060487 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-9201342e-5189-4fa4-af34-f288e2c267c0 tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:55:02.061020 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-9201342e-5189-4fa4-af34-f288e2c267c0 tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:55:02.351212 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-9201342e-5189-4fa4-af34-f288e2c267c0 tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366d62f6b3f4a0487d37e765a3fad02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abda8fd8574437e892913c775910de0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:55:02.358357 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-9201342e-5189-4fa4-af34-f288e2c267c0 tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] 10.222.0.30 "GET /compute/v2.1/servers/ffb09c23-c1d1-4e71-9510-70dd7a07cc40" status: 200 len: 1566 microversion: 2.1 time: 0.310747 Dec 24 10:55:02.358914 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 626/1254] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:55:02 2021] GET /compute/v2.1/servers/ffb09c23-c1d1-4e71-9510-70dd7a07cc40 => generated 1566 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 24 10:55:03.375556 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-9031d95e-6377-4384-972d-c1d755afc0c2 tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:55:03.376111 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-9031d95e-6377-4384-972d-c1d755afc0c2 tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] [instance: ffb09c23-c1d1-4e71-9510-70dd7a07cc40] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:55:03.383041 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-9031d95e-6377-4384-972d-c1d755afc0c2 tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:55:03.383489 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-9031d95e-6377-4384-972d-c1d755afc0c2 tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:55:03.384268 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-9031d95e-6377-4384-972d-c1d755afc0c2 tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:55:03.384985 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-9031d95e-6377-4384-972d-c1d755afc0c2 tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:55:03.565062 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-9031d95e-6377-4384-972d-c1d755afc0c2 tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366d62f6b3f4a0487d37e765a3fad02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abda8fd8574437e892913c775910de0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:55:03.572307 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-9031d95e-6377-4384-972d-c1d755afc0c2 tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] 10.222.0.30 "GET /compute/v2.1/servers/ffb09c23-c1d1-4e71-9510-70dd7a07cc40" status: 200 len: 1566 microversion: 2.1 time: 0.200531 Dec 24 10:55:03.572895 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 629/1255] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:55:03 2021] GET /compute/v2.1/servers/ffb09c23-c1d1-4e71-9510-70dd7a07cc40 => generated 1566 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:55:04.588233 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-5d2a78e1-1d9c-42ed-9cf8-ad00ffbd4a21 tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:55:04.588763 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-5d2a78e1-1d9c-42ed-9cf8-ad00ffbd4a21 tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] [instance: ffb09c23-c1d1-4e71-9510-70dd7a07cc40] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:55:04.594975 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-5d2a78e1-1d9c-42ed-9cf8-ad00ffbd4a21 tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:55:04.595415 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-5d2a78e1-1d9c-42ed-9cf8-ad00ffbd4a21 tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:55:04.596184 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-5d2a78e1-1d9c-42ed-9cf8-ad00ffbd4a21 tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:55:04.596653 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-5d2a78e1-1d9c-42ed-9cf8-ad00ffbd4a21 tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:55:04.722856 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-5d2a78e1-1d9c-42ed-9cf8-ad00ffbd4a21 tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366d62f6b3f4a0487d37e765a3fad02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abda8fd8574437e892913c775910de0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:55:04.730356 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-5d2a78e1-1d9c-42ed-9cf8-ad00ffbd4a21 tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] 10.222.0.30 "GET /compute/v2.1/servers/ffb09c23-c1d1-4e71-9510-70dd7a07cc40" status: 200 len: 1566 microversion: 2.1 time: 0.145835 Dec 24 10:55:04.730917 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 627/1256] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:55:04 2021] GET /compute/v2.1/servers/ffb09c23-c1d1-4e71-9510-70dd7a07cc40 => generated 1566 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:55:05.747385 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-a4e14a48-837b-4153-b4cd-51fc99617bb9 tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:55:05.747962 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-a4e14a48-837b-4153-b4cd-51fc99617bb9 tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] [instance: ffb09c23-c1d1-4e71-9510-70dd7a07cc40] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:55:05.754727 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-a4e14a48-837b-4153-b4cd-51fc99617bb9 tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:55:05.755172 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-a4e14a48-837b-4153-b4cd-51fc99617bb9 tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:55:05.755942 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-a4e14a48-837b-4153-b4cd-51fc99617bb9 tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:55:05.756371 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-a4e14a48-837b-4153-b4cd-51fc99617bb9 tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:55:05.890318 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-a4e14a48-837b-4153-b4cd-51fc99617bb9 tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366d62f6b3f4a0487d37e765a3fad02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abda8fd8574437e892913c775910de0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:55:05.898324 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-a4e14a48-837b-4153-b4cd-51fc99617bb9 tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] 10.222.0.30 "GET /compute/v2.1/servers/ffb09c23-c1d1-4e71-9510-70dd7a07cc40" status: 200 len: 1566 microversion: 2.1 time: 0.154703 Dec 24 10:55:05.898896 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 630/1257] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:55:05 2021] GET /compute/v2.1/servers/ffb09c23-c1d1-4e71-9510-70dd7a07cc40 => generated 1566 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:55:06.916001 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-96361bdb-764f-4327-a88c-6cac461ecdf2 tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:55:06.916606 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-96361bdb-764f-4327-a88c-6cac461ecdf2 tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] [instance: ffb09c23-c1d1-4e71-9510-70dd7a07cc40] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:55:06.923125 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-96361bdb-764f-4327-a88c-6cac461ecdf2 tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:55:06.923569 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-96361bdb-764f-4327-a88c-6cac461ecdf2 tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:55:06.925058 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-96361bdb-764f-4327-a88c-6cac461ecdf2 tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:55:06.925474 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-96361bdb-764f-4327-a88c-6cac461ecdf2 tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:55:07.062954 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-96361bdb-764f-4327-a88c-6cac461ecdf2 tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366d62f6b3f4a0487d37e765a3fad02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abda8fd8574437e892913c775910de0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:55:07.072232 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-96361bdb-764f-4327-a88c-6cac461ecdf2 tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] 10.222.0.30 "GET /compute/v2.1/servers/ffb09c23-c1d1-4e71-9510-70dd7a07cc40" status: 200 len: 1567 microversion: 2.1 time: 0.160098 Dec 24 10:55:07.072795 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 628/1258] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:55:06 2021] GET /compute/v2.1/servers/ffb09c23-c1d1-4e71-9510-70dd7a07cc40 => generated 1567 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:55:07.089496 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-077ba06b-854d-47e7-9c0e-38f8bd5ad489 tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:55:07.090046 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-077ba06b-854d-47e7-9c0e-38f8bd5ad489 tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] [instance: ffb09c23-c1d1-4e71-9510-70dd7a07cc40] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:55:07.096327 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-077ba06b-854d-47e7-9c0e-38f8bd5ad489 tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:55:07.096770 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-077ba06b-854d-47e7-9c0e-38f8bd5ad489 tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:55:07.097568 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-077ba06b-854d-47e7-9c0e-38f8bd5ad489 tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:55:07.097995 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-077ba06b-854d-47e7-9c0e-38f8bd5ad489 tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:55:07.398215 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-077ba06b-854d-47e7-9c0e-38f8bd5ad489 tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] 10.222.0.30 "POST /compute/v2.1/servers/ffb09c23-c1d1-4e71-9510-70dd7a07cc40/action" status: 202 len: 0 microversion: 2.1 time: 0.312414 Dec 24 10:55:07.398837 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 631/1259] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Dec 24 10:55:07 2021] POST /compute/v2.1/servers/ffb09c23-c1d1-4e71-9510-70dd7a07cc40/action => generated 0 bytes in 314 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 24 10:55:07.406646 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-942c18bc-f18c-4e40-895b-952adf0fa3a1 tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:55:07.407270 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-942c18bc-f18c-4e40-895b-952adf0fa3a1 tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] [instance: ffb09c23-c1d1-4e71-9510-70dd7a07cc40] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:55:07.413983 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-942c18bc-f18c-4e40-895b-952adf0fa3a1 tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:55:07.414561 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-942c18bc-f18c-4e40-895b-952adf0fa3a1 tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:55:07.415355 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-942c18bc-f18c-4e40-895b-952adf0fa3a1 tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:55:07.415919 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-942c18bc-f18c-4e40-895b-952adf0fa3a1 tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:55:07.569494 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-942c18bc-f18c-4e40-895b-952adf0fa3a1 tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366d62f6b3f4a0487d37e765a3fad02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abda8fd8574437e892913c775910de0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:55:07.577069 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-942c18bc-f18c-4e40-895b-952adf0fa3a1 tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] 10.222.0.30 "GET /compute/v2.1/servers/ffb09c23-c1d1-4e71-9510-70dd7a07cc40" status: 200 len: 1515 microversion: 2.1 time: 0.174098 Dec 24 10:55:07.577635 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 629/1260] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:55:07 2021] GET /compute/v2.1/servers/ffb09c23-c1d1-4e71-9510-70dd7a07cc40 => generated 1515 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:55:08.593696 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-45e4c37c-f7d9-4b16-bf12-3fdced308d7d tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:55:08.594233 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-45e4c37c-f7d9-4b16-bf12-3fdced308d7d tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] [instance: ffb09c23-c1d1-4e71-9510-70dd7a07cc40] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:55:08.599909 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-45e4c37c-f7d9-4b16-bf12-3fdced308d7d tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:55:08.600364 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-45e4c37c-f7d9-4b16-bf12-3fdced308d7d tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:55:08.601200 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-45e4c37c-f7d9-4b16-bf12-3fdced308d7d tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:55:08.601636 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-45e4c37c-f7d9-4b16-bf12-3fdced308d7d tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:55:08.733355 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-45e4c37c-f7d9-4b16-bf12-3fdced308d7d tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366d62f6b3f4a0487d37e765a3fad02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abda8fd8574437e892913c775910de0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:55:08.741233 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-45e4c37c-f7d9-4b16-bf12-3fdced308d7d tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] 10.222.0.30 "GET /compute/v2.1/servers/ffb09c23-c1d1-4e71-9510-70dd7a07cc40" status: 200 len: 1517 microversion: 2.1 time: 0.151784 Dec 24 10:55:08.741799 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 632/1261] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:55:08 2021] GET /compute/v2.1/servers/ffb09c23-c1d1-4e71-9510-70dd7a07cc40 => generated 1517 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:55:09.137740 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [req-396d7745-a15d-4e3a-8c45-f1f4d2fb77e7 req-7cfd4a16-9ecd-4736-b70e-692a865cd20d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ffb09c23-c1d1-4e71-9510-70dd7a07cc40", "name": "network-vif-unplugged", "status": "completed", "tag": "d66f0143-a5b5-43e9-9377-65eedc43836e"}]} {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:55:09.139831 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 10:55:09.139831 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: warnings.warn(msg) Dec 24 10:55:09.147901 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [req-396d7745-a15d-4e3a-8c45-f1f4d2fb77e7 req-7cfd4a16-9ecd-4736-b70e-692a865cd20d service nova] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:55:09.148368 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [req-396d7745-a15d-4e3a-8c45-f1f4d2fb77e7 req-7cfd4a16-9ecd-4736-b70e-692a865cd20d service nova] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:55:09.160064 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.compute.server_external_events [req-396d7745-a15d-4e3a-8c45-f1f4d2fb77e7 req-7cfd4a16-9ecd-4736-b70e-692a865cd20d service nova] Unable to find a host for instance ffb09c23-c1d1-4e71-9510-70dd7a07cc40. Dropping event network-vif-unplugged {{(pid=123432) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:138}} Dec 24 10:55:09.160956 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [req-396d7745-a15d-4e3a-8c45-f1f4d2fb77e7 req-7cfd4a16-9ecd-4736-b70e-692a865cd20d service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.027995 Dec 24 10:55:09.161524 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 630/1262] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Dec 24 10:55:09 2021] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 30 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Dec 24 10:55:09.809305 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-15cf6d69-a944-4db8-95eb-3b88e43aadf7 tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:55:09.809907 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-15cf6d69-a944-4db8-95eb-3b88e43aadf7 tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] [instance: ffb09c23-c1d1-4e71-9510-70dd7a07cc40] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:55:09.816809 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-15cf6d69-a944-4db8-95eb-3b88e43aadf7 tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:55:09.817276 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-15cf6d69-a944-4db8-95eb-3b88e43aadf7 tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:55:09.818051 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-15cf6d69-a944-4db8-95eb-3b88e43aadf7 tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:55:09.818476 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-15cf6d69-a944-4db8-95eb-3b88e43aadf7 tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:55:09.959535 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-15cf6d69-a944-4db8-95eb-3b88e43aadf7 tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366d62f6b3f4a0487d37e765a3fad02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abda8fd8574437e892913c775910de0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:55:09.966929 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-15cf6d69-a944-4db8-95eb-3b88e43aadf7 tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] 10.222.0.30 "GET /compute/v2.1/servers/ffb09c23-c1d1-4e71-9510-70dd7a07cc40" status: 200 len: 1517 microversion: 2.1 time: 0.161392 Dec 24 10:55:09.967494 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 633/1263] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:55:09 2021] GET /compute/v2.1/servers/ffb09c23-c1d1-4e71-9510-70dd7a07cc40 => generated 1517 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:55:10.983161 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-e5357249-a4e1-44dc-9228-1ba32ddfb766 tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:55:10.983766 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-e5357249-a4e1-44dc-9228-1ba32ddfb766 tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] [instance: ffb09c23-c1d1-4e71-9510-70dd7a07cc40] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:55:10.990148 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-e5357249-a4e1-44dc-9228-1ba32ddfb766 tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:55:10.990587 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-e5357249-a4e1-44dc-9228-1ba32ddfb766 tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:55:10.991353 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-e5357249-a4e1-44dc-9228-1ba32ddfb766 tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:55:10.991778 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-e5357249-a4e1-44dc-9228-1ba32ddfb766 tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:55:11.122480 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-e5357249-a4e1-44dc-9228-1ba32ddfb766 tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366d62f6b3f4a0487d37e765a3fad02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abda8fd8574437e892913c775910de0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:55:11.130339 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-e5357249-a4e1-44dc-9228-1ba32ddfb766 tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] 10.222.0.30 "GET /compute/v2.1/servers/ffb09c23-c1d1-4e71-9510-70dd7a07cc40" status: 200 len: 1573 microversion: 2.1 time: 0.150824 Dec 24 10:55:11.131065 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 631/1264] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:55:10 2021] GET /compute/v2.1/servers/ffb09c23-c1d1-4e71-9510-70dd7a07cc40 => generated 1573 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:55:12.147745 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-87fea6e0-445b-4084-a4f3-7f2d402aebc8 tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:55:12.148393 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-87fea6e0-445b-4084-a4f3-7f2d402aebc8 tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] [instance: ffb09c23-c1d1-4e71-9510-70dd7a07cc40] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:55:12.154864 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-87fea6e0-445b-4084-a4f3-7f2d402aebc8 tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:55:12.155353 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-87fea6e0-445b-4084-a4f3-7f2d402aebc8 tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:55:12.156121 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-87fea6e0-445b-4084-a4f3-7f2d402aebc8 tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:55:12.156544 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-87fea6e0-445b-4084-a4f3-7f2d402aebc8 tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:55:12.289025 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-87fea6e0-445b-4084-a4f3-7f2d402aebc8 tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366d62f6b3f4a0487d37e765a3fad02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abda8fd8574437e892913c775910de0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:55:12.296374 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-87fea6e0-445b-4084-a4f3-7f2d402aebc8 tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] 10.222.0.30 "GET /compute/v2.1/servers/ffb09c23-c1d1-4e71-9510-70dd7a07cc40" status: 200 len: 1573 microversion: 2.1 time: 0.152886 Dec 24 10:55:12.296986 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 634/1265] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:55:12 2021] GET /compute/v2.1/servers/ffb09c23-c1d1-4e71-9510-70dd7a07cc40 => generated 1573 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:55:13.313297 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-eeaaf7c2-1385-4b9b-8718-79c2a0c5f146 tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:55:13.313925 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-eeaaf7c2-1385-4b9b-8718-79c2a0c5f146 tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] [instance: ffb09c23-c1d1-4e71-9510-70dd7a07cc40] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:55:13.320212 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-eeaaf7c2-1385-4b9b-8718-79c2a0c5f146 tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:55:13.320650 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-eeaaf7c2-1385-4b9b-8718-79c2a0c5f146 tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:55:13.321461 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-eeaaf7c2-1385-4b9b-8718-79c2a0c5f146 tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:55:13.321882 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-eeaaf7c2-1385-4b9b-8718-79c2a0c5f146 tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:55:13.452891 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-eeaaf7c2-1385-4b9b-8718-79c2a0c5f146 tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366d62f6b3f4a0487d37e765a3fad02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abda8fd8574437e892913c775910de0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:55:13.460292 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-eeaaf7c2-1385-4b9b-8718-79c2a0c5f146 tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] 10.222.0.30 "GET /compute/v2.1/servers/ffb09c23-c1d1-4e71-9510-70dd7a07cc40" status: 200 len: 1573 microversion: 2.1 time: 0.150719 Dec 24 10:55:13.460868 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 632/1266] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:55:13 2021] GET /compute/v2.1/servers/ffb09c23-c1d1-4e71-9510-70dd7a07cc40 => generated 1573 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:55:14.476038 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-c9bc1ade-3ffe-4607-9a3f-612be6dd7636 tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:55:14.476627 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-c9bc1ade-3ffe-4607-9a3f-612be6dd7636 tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] [instance: ffb09c23-c1d1-4e71-9510-70dd7a07cc40] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:55:14.483091 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-c9bc1ade-3ffe-4607-9a3f-612be6dd7636 tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:55:14.483539 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-c9bc1ade-3ffe-4607-9a3f-612be6dd7636 tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:55:14.484341 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-c9bc1ade-3ffe-4607-9a3f-612be6dd7636 tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:55:14.484773 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-c9bc1ade-3ffe-4607-9a3f-612be6dd7636 tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:55:14.611228 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-c9bc1ade-3ffe-4607-9a3f-612be6dd7636 tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366d62f6b3f4a0487d37e765a3fad02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abda8fd8574437e892913c775910de0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:55:14.618868 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-c9bc1ade-3ffe-4607-9a3f-612be6dd7636 tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] 10.222.0.30 "GET /compute/v2.1/servers/ffb09c23-c1d1-4e71-9510-70dd7a07cc40" status: 200 len: 1573 microversion: 2.1 time: 0.146462 Dec 24 10:55:14.619425 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 635/1267] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:55:14 2021] GET /compute/v2.1/servers/ffb09c23-c1d1-4e71-9510-70dd7a07cc40 => generated 1573 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:55:15.636247 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-470ba030-c412-45a5-afac-4dd753537777 tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:55:15.636873 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-470ba030-c412-45a5-afac-4dd753537777 tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] [instance: ffb09c23-c1d1-4e71-9510-70dd7a07cc40] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:55:15.643119 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-470ba030-c412-45a5-afac-4dd753537777 tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:55:15.644186 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-470ba030-c412-45a5-afac-4dd753537777 tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:55:15.644988 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-470ba030-c412-45a5-afac-4dd753537777 tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:55:15.645418 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-470ba030-c412-45a5-afac-4dd753537777 tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:55:15.780245 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-470ba030-c412-45a5-afac-4dd753537777 tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366d62f6b3f4a0487d37e765a3fad02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abda8fd8574437e892913c775910de0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:55:15.787532 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-470ba030-c412-45a5-afac-4dd753537777 tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] 10.222.0.30 "GET /compute/v2.1/servers/ffb09c23-c1d1-4e71-9510-70dd7a07cc40" status: 200 len: 1573 microversion: 2.1 time: 0.155216 Dec 24 10:55:15.788090 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 633/1268] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:55:15 2021] GET /compute/v2.1/servers/ffb09c23-c1d1-4e71-9510-70dd7a07cc40 => generated 1573 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:55:16.808292 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-9fe60040-6b70-4d79-b5f0-73c0312f2e8c tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:55:16.808916 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-9fe60040-6b70-4d79-b5f0-73c0312f2e8c tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] [instance: ffb09c23-c1d1-4e71-9510-70dd7a07cc40] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:55:16.815824 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-9fe60040-6b70-4d79-b5f0-73c0312f2e8c tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:55:16.816271 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-9fe60040-6b70-4d79-b5f0-73c0312f2e8c tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:55:16.817084 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-9fe60040-6b70-4d79-b5f0-73c0312f2e8c tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:55:16.817518 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-9fe60040-6b70-4d79-b5f0-73c0312f2e8c tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:55:16.949613 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-9fe60040-6b70-4d79-b5f0-73c0312f2e8c tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366d62f6b3f4a0487d37e765a3fad02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abda8fd8574437e892913c775910de0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:55:16.957411 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-9fe60040-6b70-4d79-b5f0-73c0312f2e8c tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] 10.222.0.30 "GET /compute/v2.1/servers/ffb09c23-c1d1-4e71-9510-70dd7a07cc40" status: 200 len: 1573 microversion: 2.1 time: 0.152827 Dec 24 10:55:16.957973 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 636/1269] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:55:16 2021] GET /compute/v2.1/servers/ffb09c23-c1d1-4e71-9510-70dd7a07cc40 => generated 1573 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:55:17.975169 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-8943b8ab-de1d-474b-9ed8-ee1b2b24f57a tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:55:17.976055 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-8943b8ab-de1d-474b-9ed8-ee1b2b24f57a tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] [instance: ffb09c23-c1d1-4e71-9510-70dd7a07cc40] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:55:17.983585 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-8943b8ab-de1d-474b-9ed8-ee1b2b24f57a tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:55:17.984092 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-8943b8ab-de1d-474b-9ed8-ee1b2b24f57a tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:55:17.984903 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-8943b8ab-de1d-474b-9ed8-ee1b2b24f57a tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:55:17.985340 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-8943b8ab-de1d-474b-9ed8-ee1b2b24f57a tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:55:18.114150 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-8943b8ab-de1d-474b-9ed8-ee1b2b24f57a tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366d62f6b3f4a0487d37e765a3fad02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abda8fd8574437e892913c775910de0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:55:18.121382 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-8943b8ab-de1d-474b-9ed8-ee1b2b24f57a tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] 10.222.0.30 "GET /compute/v2.1/servers/ffb09c23-c1d1-4e71-9510-70dd7a07cc40" status: 200 len: 1573 microversion: 2.1 time: 0.150610 Dec 24 10:55:18.121946 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 634/1270] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:55:17 2021] GET /compute/v2.1/servers/ffb09c23-c1d1-4e71-9510-70dd7a07cc40 => generated 1573 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:55:19.138464 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-2188e83b-2652-4caa-b92a-d56dc1b14029 tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:55:19.138916 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-2188e83b-2652-4caa-b92a-d56dc1b14029 tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] [instance: ffb09c23-c1d1-4e71-9510-70dd7a07cc40] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:55:19.148259 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-2188e83b-2652-4caa-b92a-d56dc1b14029 tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:55:19.148981 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-2188e83b-2652-4caa-b92a-d56dc1b14029 tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:55:19.150201 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-2188e83b-2652-4caa-b92a-d56dc1b14029 tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:55:19.150873 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-2188e83b-2652-4caa-b92a-d56dc1b14029 tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:55:19.294561 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-2188e83b-2652-4caa-b92a-d56dc1b14029 tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366d62f6b3f4a0487d37e765a3fad02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abda8fd8574437e892913c775910de0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:55:19.302009 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-2188e83b-2652-4caa-b92a-d56dc1b14029 tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] 10.222.0.30 "GET /compute/v2.1/servers/ffb09c23-c1d1-4e71-9510-70dd7a07cc40" status: 200 len: 1573 microversion: 2.1 time: 0.167672 Dec 24 10:55:19.308409 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 637/1271] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:55:19 2021] GET /compute/v2.1/servers/ffb09c23-c1d1-4e71-9510-70dd7a07cc40 => generated 1573 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:55:20.318674 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-5b8332da-e25c-4a10-9970-cc4864178145 tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:55:20.319265 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-5b8332da-e25c-4a10-9970-cc4864178145 tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] [instance: ffb09c23-c1d1-4e71-9510-70dd7a07cc40] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:55:20.325649 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-5b8332da-e25c-4a10-9970-cc4864178145 tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:55:20.326090 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-5b8332da-e25c-4a10-9970-cc4864178145 tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:55:20.326867 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-5b8332da-e25c-4a10-9970-cc4864178145 tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:55:20.327296 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-5b8332da-e25c-4a10-9970-cc4864178145 tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:55:20.454190 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-5b8332da-e25c-4a10-9970-cc4864178145 tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366d62f6b3f4a0487d37e765a3fad02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abda8fd8574437e892913c775910de0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:55:20.462020 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-5b8332da-e25c-4a10-9970-cc4864178145 tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] 10.222.0.30 "GET /compute/v2.1/servers/ffb09c23-c1d1-4e71-9510-70dd7a07cc40" status: 200 len: 1573 microversion: 2.1 time: 0.147112 Dec 24 10:55:20.462588 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 635/1272] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:55:20 2021] GET /compute/v2.1/servers/ffb09c23-c1d1-4e71-9510-70dd7a07cc40 => generated 1573 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:55:21.323307 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [req-0b09e361-2e91-4e57-a370-41bfd41fcd8e req-737cf5eb-f43d-487d-a986-f449973dbfa9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ffb09c23-c1d1-4e71-9510-70dd7a07cc40", "name": "network-vif-plugged", "status": "completed", "tag": "d66f0143-a5b5-43e9-9377-65eedc43836e"}]} {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:55:21.324914 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 10:55:21.324914 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: warnings.warn(msg) Dec 24 10:55:21.332250 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [req-0b09e361-2e91-4e57-a370-41bfd41fcd8e req-737cf5eb-f43d-487d-a986-f449973dbfa9 service nova] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:55:21.332686 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [req-0b09e361-2e91-4e57-a370-41bfd41fcd8e req-737cf5eb-f43d-487d-a986-f449973dbfa9 service nova] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:55:21.343283 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.compute.server_external_events [req-0b09e361-2e91-4e57-a370-41bfd41fcd8e req-737cf5eb-f43d-487d-a986-f449973dbfa9 service nova] Creating event network-vif-plugged:d66f0143-a5b5-43e9-9377-65eedc43836e for instance ffb09c23-c1d1-4e71-9510-70dd7a07cc40 on hv-cinder-81644 Dec 24 10:55:21.349218 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [req-0b09e361-2e91-4e57-a370-41bfd41fcd8e req-737cf5eb-f43d-487d-a986-f449973dbfa9 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029527 Dec 24 10:55:21.356838 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 638/1273] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Dec 24 10:55:21 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 10:55:21.479249 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-98a713fb-2c1c-449d-abde-9c0e7fedddea tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:55:21.479867 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-98a713fb-2c1c-449d-abde-9c0e7fedddea tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] [instance: ffb09c23-c1d1-4e71-9510-70dd7a07cc40] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:55:21.485920 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-98a713fb-2c1c-449d-abde-9c0e7fedddea tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:55:21.486377 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-98a713fb-2c1c-449d-abde-9c0e7fedddea tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:55:21.487810 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-98a713fb-2c1c-449d-abde-9c0e7fedddea tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:55:21.488248 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-98a713fb-2c1c-449d-abde-9c0e7fedddea tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:55:21.626793 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-98a713fb-2c1c-449d-abde-9c0e7fedddea tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366d62f6b3f4a0487d37e765a3fad02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abda8fd8574437e892913c775910de0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:55:21.632129 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-98a713fb-2c1c-449d-abde-9c0e7fedddea tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] 10.222.0.30 "GET /compute/v2.1/servers/ffb09c23-c1d1-4e71-9510-70dd7a07cc40" status: 200 len: 1573 microversion: 2.1 time: 0.156531 Dec 24 10:55:21.632707 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 636/1274] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:55:21 2021] GET /compute/v2.1/servers/ffb09c23-c1d1-4e71-9510-70dd7a07cc40 => generated 1573 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:55:22.649909 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-0c3752bf-dc2c-4bfd-b277-6e2fa9e62f3d tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:55:22.650601 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-0c3752bf-dc2c-4bfd-b277-6e2fa9e62f3d tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] [instance: ffb09c23-c1d1-4e71-9510-70dd7a07cc40] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:55:22.657113 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-0c3752bf-dc2c-4bfd-b277-6e2fa9e62f3d tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:55:22.657550 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-0c3752bf-dc2c-4bfd-b277-6e2fa9e62f3d tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:55:22.658310 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-0c3752bf-dc2c-4bfd-b277-6e2fa9e62f3d tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:55:22.658762 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-0c3752bf-dc2c-4bfd-b277-6e2fa9e62f3d tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:55:22.792774 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-0c3752bf-dc2c-4bfd-b277-6e2fa9e62f3d tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366d62f6b3f4a0487d37e765a3fad02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abda8fd8574437e892913c775910de0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:55:22.800641 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-0c3752bf-dc2c-4bfd-b277-6e2fa9e62f3d tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] 10.222.0.30 "GET /compute/v2.1/servers/ffb09c23-c1d1-4e71-9510-70dd7a07cc40" status: 200 len: 1573 microversion: 2.1 time: 0.154752 Dec 24 10:55:22.801234 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 639/1275] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:55:22 2021] GET /compute/v2.1/servers/ffb09c23-c1d1-4e71-9510-70dd7a07cc40 => generated 1573 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:55:23.817950 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-7459e87d-d61d-4deb-8a72-005d4e4e01f4 tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:55:23.818558 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-7459e87d-d61d-4deb-8a72-005d4e4e01f4 tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] [instance: ffb09c23-c1d1-4e71-9510-70dd7a07cc40] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:55:23.824836 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-7459e87d-d61d-4deb-8a72-005d4e4e01f4 tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:55:23.825304 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-7459e87d-d61d-4deb-8a72-005d4e4e01f4 tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:55:23.826080 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-7459e87d-d61d-4deb-8a72-005d4e4e01f4 tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:55:23.826513 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-7459e87d-d61d-4deb-8a72-005d4e4e01f4 tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:55:23.953802 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-7459e87d-d61d-4deb-8a72-005d4e4e01f4 tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366d62f6b3f4a0487d37e765a3fad02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abda8fd8574437e892913c775910de0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:55:23.961668 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-7459e87d-d61d-4deb-8a72-005d4e4e01f4 tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] 10.222.0.30 "GET /compute/v2.1/servers/ffb09c23-c1d1-4e71-9510-70dd7a07cc40" status: 200 len: 1560 microversion: 2.1 time: 0.148050 Dec 24 10:55:23.962228 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 637/1276] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:55:23 2021] GET /compute/v2.1/servers/ffb09c23-c1d1-4e71-9510-70dd7a07cc40 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:56:06.043144 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-e8575a5b-4b90-49d8-823b-fd3d35f26600 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:56:06.043672 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-e8575a5b-4b90-49d8-823b-fd3d35f26600 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] [instance: f4571cb7-621b-44dd-9b6f-5f13e4ddb918] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:56:06.050980 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-e8575a5b-4b90-49d8-823b-fd3d35f26600 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:56:06.051451 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-e8575a5b-4b90-49d8-823b-fd3d35f26600 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:56:06.052273 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-e8575a5b-4b90-49d8-823b-fd3d35f26600 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:56:06.052894 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-e8575a5b-4b90-49d8-823b-fd3d35f26600 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:56:06.078582 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-e8575a5b-4b90-49d8-823b-fd3d35f26600 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] [instance: f4571cb7-621b-44dd-9b6f-5f13e4ddb918] Going to try to terminate instance {{(pid=123431) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 24 10:56:06.115706 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [req-a351375f-645b-4ab6-a7b4-753fb8a07637 req-0667011c-9e69-4210-9624-ee0e55cd3990 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f4571cb7-621b-44dd-9b6f-5f13e4ddb918", "tag": "64a9ec23-cf36-4986-aad5-30b008dd3191"}]} {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:56:06.117177 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 10:56:06.117177 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: warnings.warn(msg) Dec 24 10:56:06.124559 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [req-a351375f-645b-4ab6-a7b4-753fb8a07637 req-0667011c-9e69-4210-9624-ee0e55cd3990 service nova] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:56:06.125109 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [req-a351375f-645b-4ab6-a7b4-753fb8a07637 req-0667011c-9e69-4210-9624-ee0e55cd3990 service nova] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:56:06.136613 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.compute.server_external_events [req-a351375f-645b-4ab6-a7b4-753fb8a07637 req-0667011c-9e69-4210-9624-ee0e55cd3990 service nova] Creating event network-changed:64a9ec23-cf36-4986-aad5-30b008dd3191 for instance f4571cb7-621b-44dd-9b6f-5f13e4ddb918 on hv-cinder-81644 Dec 24 10:56:06.142407 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [req-a351375f-645b-4ab6-a7b4-753fb8a07637 req-0667011c-9e69-4210-9624-ee0e55cd3990 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094124 Dec 24 10:56:06.143628 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 638/1277] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Dec 24 10:56:06 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 10:56:06.410833 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-e8575a5b-4b90-49d8-823b-fd3d35f26600 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] 10.222.0.30 "DELETE /compute/v2.1/servers/f4571cb7-621b-44dd-9b6f-5f13e4ddb918" status: 204 len: 0 microversion: 2.1 time: 0.370786 Dec 24 10:56:06.412581 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 640/1278] 10.222.0.30 () {58 vars in 1238 bytes} [Fri Dec 24 10:56:06 2021] DELETE /compute/v2.1/servers/f4571cb7-621b-44dd-9b6f-5f13e4ddb918 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 24 10:56:06.420376 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-677fe50f-7d16-4454-b2dc-88dadb0b3721 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:56:06.421469 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-677fe50f-7d16-4454-b2dc-88dadb0b3721 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] [instance: f4571cb7-621b-44dd-9b6f-5f13e4ddb918] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:56:06.427977 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-677fe50f-7d16-4454-b2dc-88dadb0b3721 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:56:06.428693 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-677fe50f-7d16-4454-b2dc-88dadb0b3721 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:56:06.429575 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-677fe50f-7d16-4454-b2dc-88dadb0b3721 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:56:06.430006 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-677fe50f-7d16-4454-b2dc-88dadb0b3721 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:56:06.568502 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-677fe50f-7d16-4454-b2dc-88dadb0b3721 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b690a952a1704197baf5e653e27160f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0fd34670674906aa9a61200251b76c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:56:06.576367 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-677fe50f-7d16-4454-b2dc-88dadb0b3721 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] 10.222.0.30 "GET /compute/v2.1/servers/f4571cb7-621b-44dd-9b6f-5f13e4ddb918" status: 200 len: 1578 microversion: 2.1 time: 0.159713 Dec 24 10:56:06.585665 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 639/1279] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:56:06 2021] GET /compute/v2.1/servers/f4571cb7-621b-44dd-9b6f-5f13e4ddb918 => generated 1578 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:56:07.593282 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-8b7e83d9-8989-4344-86a2-7565b218a109 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:56:07.593979 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-8b7e83d9-8989-4344-86a2-7565b218a109 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] [instance: f4571cb7-621b-44dd-9b6f-5f13e4ddb918] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:56:07.600871 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-8b7e83d9-8989-4344-86a2-7565b218a109 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:56:07.601319 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-8b7e83d9-8989-4344-86a2-7565b218a109 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:56:07.602090 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-8b7e83d9-8989-4344-86a2-7565b218a109 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:56:07.602523 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-8b7e83d9-8989-4344-86a2-7565b218a109 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:56:07.733844 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-8b7e83d9-8989-4344-86a2-7565b218a109 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b690a952a1704197baf5e653e27160f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0fd34670674906aa9a61200251b76c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:56:07.741217 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-8b7e83d9-8989-4344-86a2-7565b218a109 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] 10.222.0.30 "GET /compute/v2.1/servers/f4571cb7-621b-44dd-9b6f-5f13e4ddb918" status: 200 len: 1459 microversion: 2.1 time: 0.152003 Dec 24 10:56:07.745227 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 641/1280] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:56:07 2021] GET /compute/v2.1/servers/f4571cb7-621b-44dd-9b6f-5f13e4ddb918 => generated 1459 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:56:08.475129 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [req-17e88916-c9e7-4359-b900-7aa0c6830f57 req-2c9e3c4c-4832-4ee6-9742-0ce841c18896 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4571cb7-621b-44dd-9b6f-5f13e4ddb918", "name": "network-vif-deleted", "tag": "64a9ec23-cf36-4986-aad5-30b008dd3191"}]} {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:56:08.476628 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 10:56:08.476628 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: warnings.warn(msg) Dec 24 10:56:08.483859 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [req-17e88916-c9e7-4359-b900-7aa0c6830f57 req-2c9e3c4c-4832-4ee6-9742-0ce841c18896 service nova] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:56:08.489237 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [req-17e88916-c9e7-4359-b900-7aa0c6830f57 req-2c9e3c4c-4832-4ee6-9742-0ce841c18896 service nova] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:56:08.495271 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.compute.server_external_events [req-17e88916-c9e7-4359-b900-7aa0c6830f57 req-2c9e3c4c-4832-4ee6-9742-0ce841c18896 service nova] Creating event network-vif-deleted:64a9ec23-cf36-4986-aad5-30b008dd3191 for instance f4571cb7-621b-44dd-9b6f-5f13e4ddb918 on hv-cinder-81644 Dec 24 10:56:08.500570 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [req-17e88916-c9e7-4359-b900-7aa0c6830f57 req-2c9e3c4c-4832-4ee6-9742-0ce841c18896 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028941 Dec 24 10:56:08.501169 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 640/1281] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Dec 24 10:56:08 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 10:56:08.758518 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-d395542f-bd13-44c7-8c02-ffa126b84c57 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:56:08.759139 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-d395542f-bd13-44c7-8c02-ffa126b84c57 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] [instance: f4571cb7-621b-44dd-9b6f-5f13e4ddb918] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:56:08.765842 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-d395542f-bd13-44c7-8c02-ffa126b84c57 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:56:08.766275 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-d395542f-bd13-44c7-8c02-ffa126b84c57 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:56:08.767068 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-d395542f-bd13-44c7-8c02-ffa126b84c57 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:56:08.767506 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-d395542f-bd13-44c7-8c02-ffa126b84c57 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:56:08.837017 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-d395542f-bd13-44c7-8c02-ffa126b84c57 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b690a952a1704197baf5e653e27160f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0fd34670674906aa9a61200251b76c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:56:08.843629 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-d395542f-bd13-44c7-8c02-ffa126b84c57 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] 10.222.0.30 "GET /compute/v2.1/servers/f4571cb7-621b-44dd-9b6f-5f13e4ddb918" status: 200 len: 1226 microversion: 2.1 time: 0.089209 Dec 24 10:56:08.844319 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 642/1282] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:56:08 2021] GET /compute/v2.1/servers/f4571cb7-621b-44dd-9b6f-5f13e4ddb918 => generated 1226 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:56:09.861926 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-09778ed2-c710-4d6e-b13a-fe696c2da31c tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:56:09.862660 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-09778ed2-c710-4d6e-b13a-fe696c2da31c tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] [instance: f4571cb7-621b-44dd-9b6f-5f13e4ddb918] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:56:09.869067 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-09778ed2-c710-4d6e-b13a-fe696c2da31c tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:56:09.869543 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-09778ed2-c710-4d6e-b13a-fe696c2da31c tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:56:09.870393 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-09778ed2-c710-4d6e-b13a-fe696c2da31c tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:56:09.870825 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-09778ed2-c710-4d6e-b13a-fe696c2da31c tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:56:09.885127 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.wsgi [None req-09778ed2-c710-4d6e-b13a-fe696c2da31c tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] HTTP exception thrown: Instance f4571cb7-621b-44dd-9b6f-5f13e4ddb918 could not be found. Dec 24 10:56:09.885735 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-09778ed2-c710-4d6e-b13a-fe696c2da31c tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Returning 404 to user: Instance f4571cb7-621b-44dd-9b6f-5f13e4ddb918 could not be found. {{(pid=123432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 24 10:56:09.886653 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-09778ed2-c710-4d6e-b13a-fe696c2da31c tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] 10.222.0.30 "GET /compute/v2.1/servers/f4571cb7-621b-44dd-9b6f-5f13e4ddb918" status: 404 len: 111 microversion: 2.1 time: 0.029489 Dec 24 10:56:09.887176 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 641/1283] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:56:09 2021] GET /compute/v2.1/servers/f4571cb7-621b-44dd-9b6f-5f13e4ddb918 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 24 10:56:13.506995 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-df701aa9-6716-44e7-845b-d4fd57192b30 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:56:13.507744 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-df701aa9-6716-44e7-845b-d4fd57192b30 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] [instance: 6d8fff5e-934d-469e-8a9b-8457f3a062cf] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:56:13.510508 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [req-b90527a9-4be7-4c23-bab9-610e84555291 req-894b5f28-fdf5-47f1-9e26-f7b960269bf6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6d8fff5e-934d-469e-8a9b-8457f3a062cf", "tag": "1d65157c-7f7f-44f7-86a3-f01fae63875b"}]} {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:56:13.512107 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 10:56:13.512107 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: warnings.warn(msg) Dec 24 10:56:13.514223 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-df701aa9-6716-44e7-845b-d4fd57192b30 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:56:13.514924 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-df701aa9-6716-44e7-845b-d4fd57192b30 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:56:13.515886 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-df701aa9-6716-44e7-845b-d4fd57192b30 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:56:13.516550 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-df701aa9-6716-44e7-845b-d4fd57192b30 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:56:13.520227 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [req-b90527a9-4be7-4c23-bab9-610e84555291 req-894b5f28-fdf5-47f1-9e26-f7b960269bf6 service nova] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:56:13.520671 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [req-b90527a9-4be7-4c23-bab9-610e84555291 req-894b5f28-fdf5-47f1-9e26-f7b960269bf6 service nova] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:56:13.531637 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.compute.server_external_events [req-b90527a9-4be7-4c23-bab9-610e84555291 req-894b5f28-fdf5-47f1-9e26-f7b960269bf6 service nova] Creating event network-changed:1d65157c-7f7f-44f7-86a3-f01fae63875b for instance 6d8fff5e-934d-469e-8a9b-8457f3a062cf on hv-cinder-81644 Dec 24 10:56:13.536964 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [req-b90527a9-4be7-4c23-bab9-610e84555291 req-894b5f28-fdf5-47f1-9e26-f7b960269bf6 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030528 Dec 24 10:56:13.538202 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 642/1284] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Dec 24 10:56:13 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 10:56:13.542157 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-df701aa9-6716-44e7-845b-d4fd57192b30 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] [instance: 6d8fff5e-934d-469e-8a9b-8457f3a062cf] Going to try to terminate instance {{(pid=123431) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 24 10:56:13.923569 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-df701aa9-6716-44e7-845b-d4fd57192b30 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] 10.222.0.30 "DELETE /compute/v2.1/servers/6d8fff5e-934d-469e-8a9b-8457f3a062cf" status: 204 len: 0 microversion: 2.1 time: 0.420077 Dec 24 10:56:13.925020 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 643/1285] 10.222.0.30 () {58 vars in 1238 bytes} [Fri Dec 24 10:56:13 2021] DELETE /compute/v2.1/servers/6d8fff5e-934d-469e-8a9b-8457f3a062cf => generated 0 bytes in 423 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 24 10:56:13.933645 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-e4ab4e4d-0712-49db-865b-05ae7d0d9b1d tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:56:13.934589 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-e4ab4e4d-0712-49db-865b-05ae7d0d9b1d tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] [instance: 6d8fff5e-934d-469e-8a9b-8457f3a062cf] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:56:13.941474 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-e4ab4e4d-0712-49db-865b-05ae7d0d9b1d tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:56:13.942070 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-e4ab4e4d-0712-49db-865b-05ae7d0d9b1d tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:56:13.943080 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-e4ab4e4d-0712-49db-865b-05ae7d0d9b1d tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:56:13.943725 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-e4ab4e4d-0712-49db-865b-05ae7d0d9b1d tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:56:14.079156 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-e4ab4e4d-0712-49db-865b-05ae7d0d9b1d tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b690a952a1704197baf5e653e27160f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0fd34670674906aa9a61200251b76c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:56:14.086766 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-e4ab4e4d-0712-49db-865b-05ae7d0d9b1d tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] 10.222.0.30 "GET /compute/v2.1/servers/6d8fff5e-934d-469e-8a9b-8457f3a062cf" status: 200 len: 1578 microversion: 2.1 time: 0.157256 Dec 24 10:56:14.087329 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 643/1286] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:56:13 2021] GET /compute/v2.1/servers/6d8fff5e-934d-469e-8a9b-8457f3a062cf => generated 1578 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 24 10:56:15.104913 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-e795b854-ed4d-44f9-9185-5c5c800afca3 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:56:15.105534 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-e795b854-ed4d-44f9-9185-5c5c800afca3 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] [instance: 6d8fff5e-934d-469e-8a9b-8457f3a062cf] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:56:15.112345 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-e795b854-ed4d-44f9-9185-5c5c800afca3 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:56:15.112787 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-e795b854-ed4d-44f9-9185-5c5c800afca3 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:56:15.113584 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-e795b854-ed4d-44f9-9185-5c5c800afca3 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:56:15.114013 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-e795b854-ed4d-44f9-9185-5c5c800afca3 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:56:15.245324 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-e795b854-ed4d-44f9-9185-5c5c800afca3 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b690a952a1704197baf5e653e27160f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0fd34670674906aa9a61200251b76c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:56:15.253130 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-e795b854-ed4d-44f9-9185-5c5c800afca3 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] 10.222.0.30 "GET /compute/v2.1/servers/6d8fff5e-934d-469e-8a9b-8457f3a062cf" status: 200 len: 1459 microversion: 2.1 time: 0.152305 Dec 24 10:56:15.253692 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 644/1287] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:56:15 2021] GET /compute/v2.1/servers/6d8fff5e-934d-469e-8a9b-8457f3a062cf => generated 1459 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:56:15.887078 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [req-6272fce7-8fb1-4b7c-a41f-d93207e48219 req-6aae7337-23fe-494e-8d08-11d7bccce20d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d8fff5e-934d-469e-8a9b-8457f3a062cf", "name": "network-vif-deleted", "tag": "1d65157c-7f7f-44f7-86a3-f01fae63875b"}]} {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:56:15.889593 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 10:56:15.889593 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: warnings.warn(msg) Dec 24 10:56:15.895665 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [req-6272fce7-8fb1-4b7c-a41f-d93207e48219 req-6aae7337-23fe-494e-8d08-11d7bccce20d service nova] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:56:15.896103 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [req-6272fce7-8fb1-4b7c-a41f-d93207e48219 req-6aae7337-23fe-494e-8d08-11d7bccce20d service nova] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:56:15.906426 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.compute.server_external_events [req-6272fce7-8fb1-4b7c-a41f-d93207e48219 req-6aae7337-23fe-494e-8d08-11d7bccce20d service nova] Creating event network-vif-deleted:1d65157c-7f7f-44f7-86a3-f01fae63875b for instance 6d8fff5e-934d-469e-8a9b-8457f3a062cf on hv-cinder-81644 Dec 24 10:56:15.911186 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [req-6272fce7-8fb1-4b7c-a41f-d93207e48219 req-6aae7337-23fe-494e-8d08-11d7bccce20d service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027701 Dec 24 10:56:15.911753 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 644/1288] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Dec 24 10:56:15 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 10:56:16.270451 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-9aae5496-386a-42fd-b59a-195c3777c161 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:56:16.271077 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-9aae5496-386a-42fd-b59a-195c3777c161 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] [instance: 6d8fff5e-934d-469e-8a9b-8457f3a062cf] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:56:16.277724 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-9aae5496-386a-42fd-b59a-195c3777c161 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:56:16.278169 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-9aae5496-386a-42fd-b59a-195c3777c161 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:56:16.278951 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-9aae5496-386a-42fd-b59a-195c3777c161 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:56:16.279378 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-9aae5496-386a-42fd-b59a-195c3777c161 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:56:16.338926 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-9aae5496-386a-42fd-b59a-195c3777c161 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b690a952a1704197baf5e653e27160f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0fd34670674906aa9a61200251b76c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:56:16.346752 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-9aae5496-386a-42fd-b59a-195c3777c161 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] 10.222.0.30 "GET /compute/v2.1/servers/6d8fff5e-934d-469e-8a9b-8457f3a062cf" status: 200 len: 1225 microversion: 2.1 time: 0.080069 Dec 24 10:56:16.354001 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 645/1289] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:56:16 2021] GET /compute/v2.1/servers/6d8fff5e-934d-469e-8a9b-8457f3a062cf => generated 1225 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:56:17.364461 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-7b8fb076-aca4-48a9-9f86-c38721b8e71d tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:56:17.365190 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-7b8fb076-aca4-48a9-9f86-c38721b8e71d tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] [instance: 6d8fff5e-934d-469e-8a9b-8457f3a062cf] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:56:17.371140 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-7b8fb076-aca4-48a9-9f86-c38721b8e71d tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:56:17.371580 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-7b8fb076-aca4-48a9-9f86-c38721b8e71d tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:56:17.372345 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-7b8fb076-aca4-48a9-9f86-c38721b8e71d tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:56:17.372774 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-7b8fb076-aca4-48a9-9f86-c38721b8e71d tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:56:17.385916 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.wsgi [None req-7b8fb076-aca4-48a9-9f86-c38721b8e71d tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] HTTP exception thrown: Instance 6d8fff5e-934d-469e-8a9b-8457f3a062cf could not be found. Dec 24 10:56:17.386489 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-7b8fb076-aca4-48a9-9f86-c38721b8e71d tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Returning 404 to user: Instance 6d8fff5e-934d-469e-8a9b-8457f3a062cf could not be found. {{(pid=123432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 24 10:56:17.387283 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-7b8fb076-aca4-48a9-9f86-c38721b8e71d tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] 10.222.0.30 "GET /compute/v2.1/servers/6d8fff5e-934d-469e-8a9b-8457f3a062cf" status: 404 len: 111 microversion: 2.1 time: 0.027509 Dec 24 10:56:17.387792 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 645/1290] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:56:17 2021] GET /compute/v2.1/servers/6d8fff5e-934d-469e-8a9b-8457f3a062cf => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 24 10:56:17.928393 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-5e8b0919-b5cf-4d38-940a-0ded4ab4b3b0 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:56:17.928933 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-5e8b0919-b5cf-4d38-940a-0ded4ab4b3b0 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] [instance: 91615e87-1e43-4d69-baab-d7af897d1ac3] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:56:17.934841 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-5e8b0919-b5cf-4d38-940a-0ded4ab4b3b0 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:56:17.935279 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-5e8b0919-b5cf-4d38-940a-0ded4ab4b3b0 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:56:17.936080 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-5e8b0919-b5cf-4d38-940a-0ded4ab4b3b0 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:56:17.936505 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-5e8b0919-b5cf-4d38-940a-0ded4ab4b3b0 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:56:17.950210 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.wsgi [None req-5e8b0919-b5cf-4d38-940a-0ded4ab4b3b0 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] HTTP exception thrown: Instance 91615e87-1e43-4d69-baab-d7af897d1ac3 could not be found. Dec 24 10:56:17.950802 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-5e8b0919-b5cf-4d38-940a-0ded4ab4b3b0 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Returning 404 to user: Instance 91615e87-1e43-4d69-baab-d7af897d1ac3 could not be found. {{(pid=123431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 24 10:56:17.951621 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-5e8b0919-b5cf-4d38-940a-0ded4ab4b3b0 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] 10.222.0.30 "DELETE /compute/v2.1/servers/91615e87-1e43-4d69-baab-d7af897d1ac3" status: 404 len: 111 microversion: 2.1 time: 0.027226 Dec 24 10:56:17.952163 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 646/1291] 10.222.0.30 () {58 vars in 1238 bytes} [Fri Dec 24 10:56:17 2021] DELETE /compute/v2.1/servers/91615e87-1e43-4d69-baab-d7af897d1ac3 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 24 10:56:17.960578 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-8e7eb8e9-122c-4550-96a1-c48d7fc5b530 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:56:17.961336 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-8e7eb8e9-122c-4550-96a1-c48d7fc5b530 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] [instance: 91615e87-1e43-4d69-baab-d7af897d1ac3] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:56:17.967165 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-8e7eb8e9-122c-4550-96a1-c48d7fc5b530 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:56:17.967686 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-8e7eb8e9-122c-4550-96a1-c48d7fc5b530 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:56:17.968557 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-8e7eb8e9-122c-4550-96a1-c48d7fc5b530 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:56:17.969105 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-8e7eb8e9-122c-4550-96a1-c48d7fc5b530 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:56:17.982551 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.wsgi [None req-8e7eb8e9-122c-4550-96a1-c48d7fc5b530 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] HTTP exception thrown: Instance 91615e87-1e43-4d69-baab-d7af897d1ac3 could not be found. Dec 24 10:56:17.983242 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-8e7eb8e9-122c-4550-96a1-c48d7fc5b530 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Returning 404 to user: Instance 91615e87-1e43-4d69-baab-d7af897d1ac3 could not be found. {{(pid=123432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 24 10:56:17.984171 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-8e7eb8e9-122c-4550-96a1-c48d7fc5b530 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] 10.222.0.30 "GET /compute/v2.1/servers/91615e87-1e43-4d69-baab-d7af897d1ac3" status: 404 len: 111 microversion: 2.1 time: 0.027214 Dec 24 10:56:17.984805 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 646/1292] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:56:17 2021] GET /compute/v2.1/servers/91615e87-1e43-4d69-baab-d7af897d1ac3 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 24 10:56:19.561800 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-4bdb5fca-dfef-4507-904b-88721360cd98 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] Calling method '.version_select at 0x7f1899d3d280>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:56:19.672250 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-4bdb5fca-dfef-4507-904b-88721360cd98 tempest-TestVolumeBootPattern-1387681297 tempest-TestVolumeBootPattern-1387681297-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-2082088977" status: 202 len: 0 microversion: 2.1 time: 0.114101 Dec 24 10:56:19.672873 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 647/1293] 10.222.0.30 () {58 vars in 1262 bytes} [Fri Dec 24 10:56:19 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-2082088977 => generated 0 bytes in 115 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 24 10:56:40.409601 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [req-e50ca186-cce4-4ae2-8e8b-2dd0180616ee req-8a776b16-3f91-487d-a563-99730a12eca1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ffb09c23-c1d1-4e71-9510-70dd7a07cc40", "tag": "d66f0143-a5b5-43e9-9377-65eedc43836e"}]} {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:56:40.411075 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 10:56:40.411075 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: warnings.warn(msg) Dec 24 10:56:40.414266 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-9feba052-8c29-489d-8012-ed674ec17566 tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:56:40.414809 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-9feba052-8c29-489d-8012-ed674ec17566 tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] [instance: ffb09c23-c1d1-4e71-9510-70dd7a07cc40] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:56:40.419093 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [req-e50ca186-cce4-4ae2-8e8b-2dd0180616ee req-8a776b16-3f91-487d-a563-99730a12eca1 service nova] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:56:40.427067 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [req-e50ca186-cce4-4ae2-8e8b-2dd0180616ee req-8a776b16-3f91-487d-a563-99730a12eca1 service nova] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:56:40.427216 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-9feba052-8c29-489d-8012-ed674ec17566 tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:56:40.427216 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-9feba052-8c29-489d-8012-ed674ec17566 tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:56:40.427216 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-9feba052-8c29-489d-8012-ed674ec17566 tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:56:40.427216 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-9feba052-8c29-489d-8012-ed674ec17566 tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:56:40.432514 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.compute.server_external_events [req-e50ca186-cce4-4ae2-8e8b-2dd0180616ee req-8a776b16-3f91-487d-a563-99730a12eca1 service nova] Creating event network-changed:d66f0143-a5b5-43e9-9377-65eedc43836e for instance ffb09c23-c1d1-4e71-9510-70dd7a07cc40 on hv-cinder-81644 Dec 24 10:56:40.439016 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [req-e50ca186-cce4-4ae2-8e8b-2dd0180616ee req-8a776b16-3f91-487d-a563-99730a12eca1 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033338 Dec 24 10:56:40.441107 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 648/1294] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Dec 24 10:56:40 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 10:56:40.447606 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-9feba052-8c29-489d-8012-ed674ec17566 tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] [instance: ffb09c23-c1d1-4e71-9510-70dd7a07cc40] Going to try to terminate instance {{(pid=123432) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 24 10:56:40.710298 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-9feba052-8c29-489d-8012-ed674ec17566 tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] 10.222.0.30 "DELETE /compute/v2.1/servers/ffb09c23-c1d1-4e71-9510-70dd7a07cc40" status: 204 len: 0 microversion: 2.1 time: 0.309240 Dec 24 10:56:40.710892 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 647/1295] 10.222.0.30 () {58 vars in 1238 bytes} [Fri Dec 24 10:56:40 2021] DELETE /compute/v2.1/servers/ffb09c23-c1d1-4e71-9510-70dd7a07cc40 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 24 10:56:40.720155 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-d5e42c95-922c-461e-874f-eda5f5625b65 tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:56:40.724715 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-d5e42c95-922c-461e-874f-eda5f5625b65 tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] [instance: ffb09c23-c1d1-4e71-9510-70dd7a07cc40] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:56:40.727538 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-d5e42c95-922c-461e-874f-eda5f5625b65 tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:56:40.728060 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-d5e42c95-922c-461e-874f-eda5f5625b65 tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:56:40.729387 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-d5e42c95-922c-461e-874f-eda5f5625b65 tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:56:40.730295 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-d5e42c95-922c-461e-874f-eda5f5625b65 tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:56:40.957827 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.policy [None req-d5e42c95-922c-461e-874f-eda5f5625b65 tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366d62f6b3f4a0487d37e765a3fad02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abda8fd8574437e892913c775910de0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123431) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:56:40.965545 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-d5e42c95-922c-461e-874f-eda5f5625b65 tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] 10.222.0.30 "GET /compute/v2.1/servers/ffb09c23-c1d1-4e71-9510-70dd7a07cc40" status: 200 len: 1566 microversion: 2.1 time: 0.249233 Dec 24 10:56:40.973661 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 649/1296] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:56:40 2021] GET /compute/v2.1/servers/ffb09c23-c1d1-4e71-9510-70dd7a07cc40 => generated 1566 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:56:41.983794 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-2da098c8-385f-434d-b0fa-05d2f88991b4 tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:56:41.984491 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-2da098c8-385f-434d-b0fa-05d2f88991b4 tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] [instance: ffb09c23-c1d1-4e71-9510-70dd7a07cc40] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:56:41.991016 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-2da098c8-385f-434d-b0fa-05d2f88991b4 tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:56:41.991462 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-2da098c8-385f-434d-b0fa-05d2f88991b4 tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:56:41.992235 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-2da098c8-385f-434d-b0fa-05d2f88991b4 tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:56:41.992673 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-2da098c8-385f-434d-b0fa-05d2f88991b4 tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:56:42.125644 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-2da098c8-385f-434d-b0fa-05d2f88991b4 tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366d62f6b3f4a0487d37e765a3fad02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abda8fd8574437e892913c775910de0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:56:42.133809 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-2da098c8-385f-434d-b0fa-05d2f88991b4 tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] 10.222.0.30 "GET /compute/v2.1/servers/ffb09c23-c1d1-4e71-9510-70dd7a07cc40" status: 200 len: 1448 microversion: 2.1 time: 0.154103 Dec 24 10:56:42.134375 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 648/1297] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:56:41 2021] GET /compute/v2.1/servers/ffb09c23-c1d1-4e71-9510-70dd7a07cc40 => generated 1448 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:56:42.755557 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [req-7ff12a14-7ba8-4862-a0bf-7e4f96cb5cdc req-861aee68-8aa4-4009-b47a-5a812ccff7e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ffb09c23-c1d1-4e71-9510-70dd7a07cc40", "name": "network-vif-deleted", "tag": "d66f0143-a5b5-43e9-9377-65eedc43836e"}]} {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 10:56:42.757429 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 10:56:42.757429 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: warnings.warn(msg) Dec 24 10:56:42.764517 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [req-7ff12a14-7ba8-4862-a0bf-7e4f96cb5cdc req-861aee68-8aa4-4009-b47a-5a812ccff7e4 service nova] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:56:42.764986 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [req-7ff12a14-7ba8-4862-a0bf-7e4f96cb5cdc req-861aee68-8aa4-4009-b47a-5a812ccff7e4 service nova] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:56:42.776132 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.compute.server_external_events [req-7ff12a14-7ba8-4862-a0bf-7e4f96cb5cdc req-861aee68-8aa4-4009-b47a-5a812ccff7e4 service nova] Creating event network-vif-deleted:d66f0143-a5b5-43e9-9377-65eedc43836e for instance ffb09c23-c1d1-4e71-9510-70dd7a07cc40 on hv-cinder-81644 Dec 24 10:56:42.780871 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [req-7ff12a14-7ba8-4862-a0bf-7e4f96cb5cdc req-861aee68-8aa4-4009-b47a-5a812ccff7e4 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028975 Dec 24 10:56:42.781522 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 650/1298] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Dec 24 10:56:42 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 10:56:43.150985 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-087f2548-81f2-4ae2-9766-52ee4f096b7c tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Calling method '>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:56:43.152104 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.compute.api [None req-087f2548-81f2-4ae2-9766-52ee4f096b7c tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] [instance: ffb09c23-c1d1-4e71-9510-70dd7a07cc40] Fetching instance by UUID {{(pid=123432) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:56:43.158330 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-087f2548-81f2-4ae2-9766-52ee4f096b7c tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:56:43.158782 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-087f2548-81f2-4ae2-9766-52ee4f096b7c tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:56:43.159812 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-087f2548-81f2-4ae2-9766-52ee4f096b7c tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:56:43.160451 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG oslo_concurrency.lockutils [None req-087f2548-81f2-4ae2-9766-52ee4f096b7c tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:56:43.227801 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.policy [None req-087f2548-81f2-4ae2-9766-52ee4f096b7c tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366d62f6b3f4a0487d37e765a3fad02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abda8fd8574437e892913c775910de0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123432) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 10:56:43.235159 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-087f2548-81f2-4ae2-9766-52ee4f096b7c tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] 10.222.0.30 "GET /compute/v2.1/servers/ffb09c23-c1d1-4e71-9510-70dd7a07cc40" status: 200 len: 1218 microversion: 2.1 time: 0.088513 Dec 24 10:56:43.235721 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 649/1299] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:56:43 2021] GET /compute/v2.1/servers/ffb09c23-c1d1-4e71-9510-70dd7a07cc40 => generated 1218 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 10:56:43.873206 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 24 10:56:43.873386 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: Fri Dec 24 10:56:43 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 24 10:56:44.252457 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-e14ef9ca-6d6d-4915-a796-df775198da2c tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Calling method '>' {{(pid=123431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:56:44.253113 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.compute.api [None req-e14ef9ca-6d6d-4915-a796-df775198da2c tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] [instance: ffb09c23-c1d1-4e71-9510-70dd7a07cc40] Fetching instance by UUID {{(pid=123431) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 10:56:44.259407 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-e14ef9ca-6d6d-4915-a796-df775198da2c tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:56:44.259854 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-e14ef9ca-6d6d-4915-a796-df775198da2c tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:56:44.260629 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-e14ef9ca-6d6d-4915-a796-df775198da2c tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 10:56:44.261092 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG oslo_concurrency.lockutils [None req-e14ef9ca-6d6d-4915-a796-df775198da2c tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Lock "bfb47192-5c7e-4e04-9bc9-d8065be13f1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 10:56:44.274623 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.wsgi [None req-e14ef9ca-6d6d-4915-a796-df775198da2c tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] HTTP exception thrown: Instance ffb09c23-c1d1-4e71-9510-70dd7a07cc40 could not be found. Dec 24 10:56:44.275214 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: DEBUG nova.api.openstack.wsgi [None req-e14ef9ca-6d6d-4915-a796-df775198da2c tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Returning 404 to user: Instance ffb09c23-c1d1-4e71-9510-70dd7a07cc40 could not be found. {{(pid=123431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 24 10:56:44.276056 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO nova.api.openstack.requestlog [None req-e14ef9ca-6d6d-4915-a796-df775198da2c tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] 10.222.0.30 "GET /compute/v2.1/servers/ffb09c23-c1d1-4e71-9510-70dd7a07cc40" status: 404 len: 111 microversion: 2.1 time: 0.028216 Dec 24 10:56:44.276596 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: [pid: 123431|app: 0|req: 651/1300] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Dec 24 10:56:44 2021] GET /compute/v2.1/servers/ffb09c23-c1d1-4e71-9510-70dd7a07cc40 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 24 10:56:44.497335 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: DEBUG nova.api.openstack.wsgi [None req-a24406d3-b26b-43ff-a3bb-2695ca1bb2e6 tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] Calling method '.version_select at 0x7f1899b09dc0>' {{(pid=123432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 10:56:44.574527 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO nova.api.openstack.requestlog [None req-a24406d3-b26b-43ff-a3bb-2695ca1bb2e6 tempest-TestShelveInstance-280354332 tempest-TestShelveInstance-280354332-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-546307184" status: 202 len: 0 microversion: 2.1 time: 0.080787 Dec 24 10:56:44.575132 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: [pid: 123432|app: 0|req: 650/1301] 10.222.0.30 () {58 vars in 1250 bytes} [Fri Dec 24 10:56:44 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-546307184 => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 24 10:58:23.076027 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 24 10:58:23.076588 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: Fri Dec 24 10:58:23 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 24 10:58:30.701499 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 24 10:58:30.702323 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: Fri Dec 24 10:58:30 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 24 10:59:34.789484 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 24 10:59:34.790130 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: Fri Dec 24 10:59:34 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 24 11:00:03.882120 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 24 11:00:03.882671 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: Fri Dec 24 11:00:03 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 24 11:01:43.084257 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 24 11:01:43.084894 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: Fri Dec 24 11:01:43 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 24 11:01:50.709340 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 24 11:01:50.709984 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: Fri Dec 24 11:01:50 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 24 11:02:00.876014 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 24 11:02:00.876459 dv-cinder-816443-3-iscsi devstack@n-api.service[123432]: Fri Dec 24 11:02:00 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 24 11:02:01.510117 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 24 11:02:01.510598 dv-cinder-816443-3-iscsi devstack@n-api.service[123431]: Fri Dec 24 11:02:01 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!